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Introduction 


This  final  report  describes  the  results  obtained  on  a  research  effort  entitled  "Electro- 
Optics  Display  Research,  Test  and  Evaluation  Laboratory  Program"  funded  by  the  U. 
S.  Army  Research  Office  contract  DAAAL03-87-K-0121. 

STATEMENT  OF  THE  PROBLEM 


The  goal  of  the  research  effort  is  to  analyze  and  develop  model  to  characterize  overall 
electro-optical  display  systems  of  particular  interest  to  US  Army  Center  for  Night 
Vision  and  Electro-Optics  at  Ft.  Belvoir,  Virginia.  The  main  thrust  of  the  research 
reported  herein  is  to  implement  accepted  standards  for  evaluating  displays,  take  an 
active  role  in  forming  new  measurement  standards,  and  provide  unbiased  evaluation 
of  displays  in  use  of  contemplated  for  military  missions.  Measurement  parameters 
include  display  brightness,  contrast,  resolution,  chromatic  range,  frequency  response, 
angular  field-of-view,  reliability,  and  sensitivity  to  environment.  Another  important 
facet  of  this  research  is  to  determine  image  dynamics  involving  the  response  time 
between  sensor  input  and  the  reaction  of  the  observer  for  influencing  what  display 
improvements,  such  as  variable  acuity  displays,  color,  contrast,  or  brightness  lead  to 
significant  improvement  in  performance. 

SUMMARY  OF  THE  MOST  IMPORTANT  RESULTS 


1.  A  theoretical  model  for  characterizing  the  dynamic  response  of  a  non-scanning 
electro-optic  display  system  is  developed.  The  model  interrelates  the  spatial  frequency 
degradations  of  an  image  display  with  both  phosphor  characteristics  and  relative 
velocity  of  the  displayed  object.  Thereafter,  the  analysis  is  extended  to  compare  the 
performances  of  types  P-20,  P-42,  and  P-1052  phosphor  based  displays. 

2.  The  degraded  images  of  dynamic  objects  obtained  by  using  a  phosphor-based 
electro-optical  display  are  analyzed  in  terms  of  dynamic  modulation  transfer  function 
(DMTF)  and  temporal  characteristics  of  the  display  system.  The  direct 
correspondence  between  the  DMTF  and  image  smear  is  used  in  developing  real-time 
techniques  for  the  restoration  of  degraded  images. 

3.  The  concepts  of  dynamic  modulation  transfer  function  (DMTF)  and  degree  of 
degradation  (DD)  are  used  for  analyzing  gray  level  image  display  of  a  phosphor  based 
display  system.  Real-time  restoration  of  the  motion-degraded  display  images  may  be 
accomplished  using  one  or  more  inverse  filters  whose  characteristics  depend  on  the 
magnitude  and  direction  of  the  motion.  Both  DMTF  and  DD  characteristics  are  used 
in  the  restoration  of  motion-degraded  images. 
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4.  A  method  for  calculating  the  modulation  transfer  function  (MTF)  of  charge-coupled 
devices  (CCD)  is  presented.  The  analysis  accommodates  both  the  time-  and  space- 
variant  properties  of  CCDs  as  well  as  input  images  moving  with  constant  velocity 
within  a  scan  interval.  The  model  developed  accounts  for  both  the  static  and  the 
dynamic  MTF  of  CCD  imaging  systems. 

5.  The  modulation  transfer  function  (MTF)  and  contrast  transfer  function  (CTF)  are 
considered  for  discrete  systems.  The  MTF  and  CTF  are  derived  for  the  charge-coupled 
device  (CCD).  The  analysis  presented  considers  the  full  effects  of  sampling  on  device 
response.  Experimental  tests  of  the  CTF  for  a  line-array  CCD  are  presented.  The 
MTF  and  CTF  are  shown  to  be  multi-valued  functions  for  discrete  systems. 

6.  A  generalized  minimum  resolvable  temperature  difference  (MRTD)  formulation  is 
identified  for  the  characterization  of  infrared  detection  systems.  The  generalized 
MRTD  equation  can  be  adapted  to  suit  the  needs  of  any  IR  system  to  be  tested.  As 
an  illustration,  the  MRTD  of  a  staring  IR  detection  system  is  derived  from  the 
generalized  MRTD  formulation. 

7.  A  device  nonspecific  dynamic  minimum  resolvable  temperature  different 
performance  model  is  developed  for  characterizing  thermal  imaging  systems  capable 
of  displaying  moving  targets. 

8.  Discrepancies  between  the  predicted  minimum  resolvable  temperature  difference 
(MRTD)  and  field  performances  are  indicative  of  the  fact  that  the  modeling  of  MRTD 
has  certain  inherent  problems.  Several  sources  for  MRTD  error  are  identified.  MRTD 
is  found  to  be  a  special  case  of  a  more  general  minimum  resolvable  luminance 
difference  (MRLD)  measure.  The  MRLD  measure  involves  absolute  temperature  and 
can  be  used  to  describe  more  generic  targets. 

LIST  OF  PUBLICATIONS  GENERATED 

The  research  effort  resulted  into  eight  refereed  journal  publications  in  Applied  Optics 
and  Optical  Engineering.  They  are  listed  below: 

J.  C.  Feltz,  and  M.  A.  Karim,  "Modulation  transfer  function  of  charge-coupled 
devices,"  Applied  Optics,  Vol.  29,  pp.  717-722,  1990. 

M.  L.  Gao,  S.  H.  Zheng,  M.  A.  Karim,  and  D.  L.  Moon,  "Restoration  of 
dynamically  degraded  gray  level  images  in  phosphor  based  display  devices," 
Optical  Engineering.  Vol.  29,  pp.  878-882,  1990. 

J.  C.  Feltz,  "Development  of  the  modulation  transfer  function  and  contrast 
transfer  function  for  discrete  systems,  particularly  charge-coupled  devices," 
Optical  Engineering.  Vol.  29,  pp.  893-904,  1990. 


M.  L.  Gao,  M.  A.  Karim,  and  S.  H.  Zheng,  "Device  nonspecific  minimum 
resolvable  temperature  difference  for  infrared  imaging  systems 
characterization,"  Optical  Engineering.  Vol.  298,  pp  905-910,  1990. 

A.  A.  S.  Awwal,  A.  K.  Cherri,  M.  A.  Karim,  and  D.  L.  Moon,  "Dynamic 
modulation  transfer  function  of  a  display  system,"  Applied  Optics.  Vol.  30,  pp. 
201-205,  1991. 

A.  K.  Cherri,  A.  A.  S.  Awwal,  M.  A.  Karim,  and  D.  L.  Moon,  "Restoration  of 
moving  binary  images  degraded  owing  to  phosphor  persistence,"  Applied 
Optics.  Vol.  30,  pp.  3734-3739,  1991. 

M.  L.  Gao,  M.  A.  Karim,  and  S.  H.  Zheng,  "Device  nonspecific  dynamic 
performance  model  for  thermal  imaging  systems.  Optical  Engineering,  Vol.  30, 
pp.  1779-1783,  1991. 

M.  A.  Karim,  M.  L.  Gao,  and  S.  H.  Zheng,  "Minimum  resolvable  temperature 
difference  model:  a  critical  evaluation,"  Optical  Engineering.  Vol.  30,  pp.  1788- 
1796,  1991. 

These  articles  are  included  in  the  appendix. 

PARTICIPATING  SCIENTIFIC  PERSONNEL 

The  scientific  personnel  supported  by  this  project  included  two  faculty  members, 

Dr.  Donald  L.  Moon,  PI 
Dr.  Mohammad  A.  Karim, 

and  seven  graduate  research  assistants.  All  of  these  graduate  students  were  pursuing 
and  eventually  received  advanced  degrees  in  electrical  engineering  as  summarized 
below. 

Mr.  Dean  Adams,  M.S. 

Mr.  Abdul  Awwal,  Ph.D. 

Mr.  Abdallah  Cherri,  Ph.D. 

Mr.  John  C.  Felz,  M.S. 

Mr.  Ming-Lun  Gao,  Ph.D. 

Mr.  Robert  A.  Michaels,  M.S. 

Ms.  Song-Hua  Zheng,  Ph.D. 


Modulation  transfer  function  of  charge-coupled  devices 


John  C.  Feltz  and  Mohammad  A.  Karim 


A  method  for  calculating  the  modulation  transfer  function  (MTF)  of  charge-coupled  devices  I  CCD)  is 
presented.  The  analysis  accommodates  both  the  time-  and  space-variant  properties  of  CCDs  as  well  as  input 
images  moving  with  constant  velocity  within  a  scan  interval.  The  model  developed  accounts  for  both  the 
static  and  the  dynamic  MTF  of  CCD  imaging  systems. 


I.  Introduction 

Charge-coupled  devices  (CCD)  are  discrete  imaging 
systems  in  both  time  and  space.  ^  Imaging  systems  are 
generally  characterized  by  the  modulation  transfer 
function  (MTF),  which  assumes  a  linear  space-invari¬ 
ant  system.-  (Consequently,  the  MTF  calculation, 
when  applied  to  CCDs,  poses  a  serious  problem. 
CCDs  are  time  and  space  variant  at  the  stales  needed 
to  calculate  the  MTF,  and  therefore  the  MTF  turns 
out  to  be  a  multivalued  function.  This  multivaluation 
gives  rise  to  the  beating  phenomenon  when  the  MTF  is 
measured  repeatedly  along  a  CCD.^  The  multivalua¬ 
tion  significantly  reduces  the  utility  of  the  MTF  in 
specifying  CCD  hardware  capabilities. 

The  MTF  is  a  commonly  used  measure  of  the  spatial 
frequency  response  of  optical  systems.  Practical  reso¬ 
lution  limits  of  systems  are  commonly  specified  by 
MTF  cutoff  values.  Because  discrete  imaging  devices, 
particularly  CCDs,  and  discrete  display  devices  are 
useful  emd  common  devices,  an  extension  of  the  MTF 
to  discrete  systems  is  necessary  to  provide  continuity 
between  continuous  and  discrete  analysis  and  design 
procedures.  The  present  work  particularly  examines 
the  MTF  of  CCDs. 

CCDs  are  most  commonly  fabricated  with  silicon 
MOS  technology  and  a  rectangular  geometry.  The 
significant  feature  of  CCD  operation  for  this  analysis  is 
the  integration  and  sampling  of  the  incident  image  in 
time  and  space.  The  aperture  effect  of  this  integra¬ 
tion  and  sampling  gives  the  limiting  values  of  the  MTF 
for  CCDs.^  The  goal  of  this  work  is  to  accurately 
predict  the  range  of  variation  of  the  MTF  for  input 
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images  of  any  spatial  frequency  and  of  constant  veloci¬ 
ty.  Accordingly,  this  work  extends  the  MTF  defini¬ 
tion  for  CCDs  to  account  for  variations  of  the  MTF,  as 
calculated  at  a  particular  location,  due  to  alignment 
effects  and  images  with  constant  velocity. 

This  work  considers  the  case  of  uniform  rectangular 
CCD  pixels  with  linear  response,  both  within  a  pixel 
and  between  pixels,  when  subjected  to  a  monochrome 
illumination.  Synchronous  charge  integration  and 
charge  transfer  for  all  pixels  is  assumed  for  simplicity. 
Because  the  MTF  is  separable  along  the  two  pixel  axes, 
the  model  developed  is  limited  to  one  spatial  dimen¬ 
sion  only.  For  simplicity  of  analysis,  however,  nonlin¬ 
ear  effects  such  as  blooming  and  incomplete  charge 
transfer  are  not  considered  in  this  work. 

11.  Development  of  the  CCD  MTF  Expression 

We  first  consider  the  MTF  expression  for  a  static 
image,  i.e.,  an  image  with  no  motion  relative  to  the 
CCD.  The  expressions  will  then  be  expanded  to  han¬ 
dle  image  motion  cheu’acterized  by  a  constant  velocity 
within  one  scan  interval.  The  input  illumination  pat¬ 
tern  for  evaluation  of  the  MTF  is  commonly  given  by^ 

/»  0.5(1  -f  C09(5)),  (1) 

where  s  is  a  general  spatial  parameter. 

This  input  pattern  specifies  the  charge  generation 
rate  in  the  active  areas  of  the  CCD,  during  the  active 
charge  generation  time.  The  MTF  is  defined  by  the 
response  of  the  CCD  to  the  input: 

(2) 

“mu  “mm 

where  fimax  and  Bmin  are  the  values  of  a  neighboring 
maximum  and  minimum,  respectively,  of  the  output. 
For  CCDs,  Bmax  and  Bmin  will  be  considered  as  the 
output  of  two  specific  pixels. 

Figure  1  gives  an  illustration  of  the  following  param¬ 
eters  defined  for  the  1-D  analysis: 

T  =  period  of  input  pattern  (mm), 
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PIXEL 

RESPONSE 

A 


n 


Fig.  1.  Definition  of  spatial  parameters. 


Tn  =  Nyquist  period  of  input  (mm), 

Ta  =  active  width  of  CCD  pixels  (mm),  and 
Ts  =  CCD  pixel  spacing,  or  pixel  pitch  (mm). 

We  define  the  normalized  pixel  width  a  and  the  nor¬ 
malized  pixel  spacing  d  as 


a  *  xTJTs, 
/3  =»  xTa/Tv, 


(3a> 

(3b) 


The  Edignment  between  the  CCD  pixels  and  the 
input  pattern  is  important  in  calculating  the  MTF.^ 
Accordingly,  we  also  define  the  following  parameters 
in  normalized  units,  as  illustrated  in  Fig.  2: 

\pH-  offset  between  a  maximum  of  the  input  pattern 
and  the  center  of  the  nearest  pixel  (rad)  and 
\pL  =  offset  between  a  minimum  of  the  input  pattern 
EUid  the  center  of  the  nearest  pixel  (rad). 

These  offsets,  or  phase  parameters,  are  limited  by 


2  "  2 

0  0 

2  2 


(4a) 


(4b) 


For  any  arbitrary  input  pattern  period,  once  a  pixel 
generating  Bmax  is  determined,  there  are  in  general  two 
pixels  which  could  generate  Smim  depending  on  ypH-  If 
\f/H  is  graduEiUy  scanned  from  —0/2  to  0/2,  the  location 
of  5niin  will  change  from  one  pixel  to  the  next.  We 
deHne  to  represent  the  critical  vsdue  of  corre¬ 
sponding  to  the  case  when  the  minimum  of  the  input 
pattern  lies  at  the  boundary  between  two  pixels,  as 
shown  in  Fig.  3.  Accordingly,  the  pixel  index  n  is  given 
by 

n  =  inUTy/T^)  +  1,  (5) 

where  int(x)  represents  the  integer  value  of  x,  so  that 

4,'„  =  ir-(n-  1/2)0.  (6) 

These  definitions  for  n  and  allow  ypi  to  be  expressed 
as 


^0’ 


(7) 


where 


normalized 

SPACE 


Fig.  2.  Definition  of  offset  parameters. 


normalized 

SPACE 

>  0 

Fig.  3.  Definition  of  pixel  index  and  critical  offset. 


't'H  -  '/■‘h- 
'/'H  >  'i'H- 


(8) 


The  above  definition  of  \pL  removes  the  uncertainty 
over  the  location  of  Bmm  and  makes  \pi  a  function  of 
and  the  physiczd  dimensions.  When  \(/h  is  less  than  \/'n, 
Bmin  is  generated  by  the  pixel  n  pixels  distant  from  the 
pixel  generating  Bmax-  When  is  greater  than 
^min  is  generated  in  the  pixel  (rt  -  1)  pixels  distant 
from  the  pixel  generating  Bmax-  When  \/n  equals 
the  two  pixels  n  Euid  (n  -  1)  distant,  bordered  by  the 
input  minimum,  generate  equad  values  for  Bmm- 
Bmax  and  Bmm  are  defined,  respectively,  as 


Bmml  “  I  0  COS(S))d9 

“  0.5(a  -P  2  sin(a/2)  cosily) 

r*l*a)2 

^min  ”  +  COS(«)|d9 

-"of2 


(9) 


(10) 


»  0.6|a  -P  2  sin(a/2)  cos(^j^)|. 

Using  Eq.  (2),  (9),  and  (10),  we  determine  the  CCD 
MTF  for  static  images  to  be 

sin(a/2)[cos(^H)  ~  cos(^h  -P  fcd)] 


MTF  = 


a  -P  siii(a/2)[cos(^H)  -P  cos(^,y  -P  Ad)j 


(11) 


where  k  has  already  been  described  by  Eq.  (8).  Note 
that,  when  k0  =  ir,  ~  =  ^r.  This  special  case 

occurs  when  Ts/Tg  is  an  integer.  For  this  special  case, 
the  MTF  reduces  to 


MTF 


2  sin(o/2)  coa(tl>„) 


(12) 


A  dyneunic  MTF®  is  calculated  next  by  using  a  mov¬ 
ing  image.  To  incorporate  linear  motion,  the  follow¬ 
ing  additional  terms  may  be  defined: 

V  -  image  velocity  (mm/s), 
y  =  CCD  charge  integration  time  (s),  and 
5  =  CCD  scfm  intervEd  (s). 

For  simplicity,  a  normalized  velocity  v  (rad/s)  is  de¬ 
fined  as 
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(13) 


time 


MAX. 


MIN 


1/  »  XV/Ty,. 

For  the  sake  of  consistency  with  the  static  MTF  ex¬ 
pression,  the  parameters  ^h,  it,  '1>h<  ^ 

fined  at  the  center  of  a  scan  time,  as  illustrated  in  Fig. 
4. 

The  expressions  for  flmai  and  Bmm  for  the  d>Tiamic 
case  are  defined,  respectively,  as 

fy/'^ 

B„„  -  (  0.5(1  +  cosUOldMt 

Ji»-f  '2  2 

»  0.5|a7  +  (2/>')  sin(a/2)  sinli'7/2)  cosl^^d.  n't* 
S„,„  -  0.5(1 -h  cos(^)IMi 

»  0.5(07  +  (2/i')  sin(o/2)  sin(0'/2)  cos(^t)(.  (15) 


Equation  (2)  can  now  be  evaluted  using  Eqs.  (14) 
EUid  (15)  to  give  the  MTF  for  the  dynamic  case: 


MTF- 


sin(a/'2)  sin(*n'/2)(coa(^4)  -  cos(^,y  +•  fed)( 
01^/2  +  sin(a/2)  sin(in'/2)(co8(^Hl  ■*" 


(16) 


Note  that,  when  v  =  0,  Eq.  (16)  degenerates  to  the 
static  case  of  Eq.  (11). 

It  has  been  shown  that  the  spatial  and  temporal 
responses  of  imaging  systems  cannot  be  separated  in 
all  conditions.^  In  particular,  CCDs  are  systems 
where  separation  is  not  valid,  because  of  their  space- 
variant  properties.  If  separation  of  the  velocity  effect 
were  possible,  the  MTF  for  a  moving  image  would  be 
the  product  of  the  MTF  calculated  from  that  image 
held  stationMy  and  a  function  dependent  only  on  ve¬ 
locity.  Equation  (16)  above  shows  that  this  is  not.  in 
general,  true  for  CCDs,  because  it  is  not  possible  to 
separate  the  velocity  terms  out  of  the  denominator  of 
Eq.  (16). 

Two  speciEd  cases  exist,  however,  where  separation 
of  a  velocity  function  gives  a  good  approximation  of  the 
true  MTF  vtdue.  The  first  occurs  when  i'y/2  is  small, 
allowing  the  approximation  sin(j'7/2)  =  vy/2  to  be  used 
on  the  second  term  of  the  denominator  of  Eq.  (16). 
The  second  occurs  when  Ty/T a  is  an  integer,  or  i/'l  —  \f/H 
=  T,  eliminating  the  second  term  of  tl’e  denominator, 
as  in  Eq.  (12)  above  for  the  static  case.  In  either  case, 
the  MTF  can  be  expressed  as 


MTF- 


sin(rv/2) 


(17) 


where  MTFstat  is  the  MTF  evaluated  without  any  ve¬ 
locity  effects,  as  in  Eq.  (11)  or  (12). 

III.  Simulation  Results 

A  fast  Fourier  transform  (FFT)  based  simulation 
has  been  developed  to  evaluate  the  imaging  abilities  of 
CCDs.  This  simulation  performs  the  charge-integra¬ 
tion  calculations  numerically  by  a  convolution  opera¬ 
tion.  The  FFT  simulation  program  has  the  advan¬ 
tages  of  speed  and  the  ability  to  calculate  CCD  output 
from  more  general  input  conditions  and  nonuniform 
pixel  response.  The  FFT  simulation  has  been  used  as 


*  * 


normalised 

space 


Fig.  4. 


Definition  of  parameters  for  the  case  of  image  velocitv 


F'  CCD 


f  »  t  » 


SHIELDED  transfer  PATmS 


■TH - TT- 

I  ; 


Fig.  5.  Frame  transfer  (FT)  and  interline  transfer  (IT)  CCD  geom¬ 
etries  anJ  UaoAler  paths. 


a  numeric  check  of  the  expressions  developed  in  Sec. 
II.  Tlie  results  discussed  below  have  been  calculated 
by  implementing  the  expressions  developed  in  Sec.  II 
on  a  personal  computer  spreadsheet  program. 

The  results  discussed  below  are  intended  to  simulate 
two  common  CCD  geometries,  shown  in  Fig.  5.  The 
frame  transfer  CCD  (FT  CCD)  is  designed  with  Ta  and 
Tg  equal  or  nearly  equal  for  both  dimensions.  The 
interline  transfer  CCD  (IT  CCD)  is  designed  with 
shielded  charge  tremsfer  paths  parallel  to  one  axis  of 
the  device,  with  the  result  that  Ta  and  are  equEil  or 
nearly  equal  for  the  dimension  parallel  to  the  charge 
transfer  paths  and  that  T„  tmd  T gl2  are  equal  or  nesuly 
equal  for  the  dimension  orthogonal  to  the  charge  trsms- 
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Fig.  6.  MTF  variation  due  to  phase  parameter  with  no  image 
velocity. 
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Fig.  7.  MTF  variation  due  to  phase  parameter  with  image  velocity. 


fer  paths.  The  results  below,  therefore,  evaluate  the 
MTF  for  the  two  general  cases  of  Ta  =  Tj  and  T„  =  TJ 
2. 

Figures  6  and  7  show  typical  MTF  curves  as  a  func¬ 
tion  of  \(/H-  Figure  6  shows  the  case  where  a  =  d-  O.Sa- 
and  V  =  0,  wh’’  ''  Fig.  7  shows  the  case  where  a  =  0.3  jt,  0 
-  0.6x,  v  =  0.  i  r,  and  7  =  1.  These  results,  and  those 
following,  are  calculated  by  allowing  to  vary  from 
—0/2  to  0/2  with  a  step  size  of  d/100.  Note  that  the 
minimum  of  each  curve  occurs  when  'Ph  -  where 
the  slope  of  the  curve  is  discontinuous. 

Figures  8  and  9  show  the  MTF  as  a  function  of 
spatial  frequency  for  the  cases  a  =  0  and  o  =  0/2, 
respectively,  with  no  image  velocity.  Any  MTF  value 
between  the  two  extreme  curves  on  the  graphs  is  possi¬ 
ble,  with  the  mean  values  represented  by  the  central 
curves.  Figure  8  is  the  static  MTF  calculated  for 
either  dimension  of  a  FT  CCD.  or  for  the  dimension  of 
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A 


0 


0 

Fig.  8.  Sutic  MTF. 
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O  MAXIMUM 
*  MEAN 
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Fig.  9.  Static  MTF. 


an  IT  CCD  that  is  peuallei  to  the  charge  transfer  paths. 
Similarly,  Fig.  9  is  the  static  MTF  calculated  for  the 
dimension  of  an  IT  CCD  that  is  orthogonal  to  the 
charge  transfer  paths.  The  data  points  for  the  maxi¬ 
mum  MTF  curve  are  obtained  by  searching  the  data 
generated  at  each  spatial  frequency.  The  data  points 
for  the  minimum  MTF  curve  are  obtained  by  evaluat¬ 
ing  the  MTF  at  spatial  frequency.  The 

data  points  for  the  mean  MTF  curve  are  obtained  by 
performing  an  arithmetic  mean  of  the  data  generated 
at  each  spatial  frequency.  This  mean  calculation  is 
justified  because  any  offset  vt/f  in  the  -0/2  to  0/2  range 
is  equally  likely  in  actual  use.  The  upper  limit  on  the 
spatial  frequency  axis  occurs  when  0  =  ir,  or  Ts=  T.v, 
corresponding  to  the  Nyquist  sampling  limit  of  the 
CCD. 
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Fig.  10.  Dynamic  MTF. 
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Fig.  11.  Dynamic  MTF. 


Figures  10  and  11  show  the  MTF  as  a  function  of 
image  velocity  for  the  cases  of  a  =  d  =  O.Sir  and  a  =  d  = 
0.7x,  respectively.  Figure  12  shows  a  comparison  be¬ 
tween  the  actual  maximum  MTF  curve  of  Fig.  11  and 
the  result  of  using  the  velocity  approximation  of  Eq. 
(17).  The  numeric  data  for  Fig.  12,  along  with  percent 
error  information,  are  presented  in  Table  I.  The  error 
values  support  the  conclusion  reached  earlier  that  ve¬ 
locity  effects  are  not  separable  from  the  overall  MTF 
expression.  However,  the  approximation  of  Eq.  (17)  is 
applicable  to  the  case  shown  in  Fig.  10,  because  it 
satisfies  the  conditions  discussed  in  Sec.  II. 

Figure  13  shows  the  mean  MTF  curve  as  a  function 
of  spatial  frequency  for  several  velocities,  with  a  =  d 
and  7  =  1.  It  can  be  observed  here  that  the  mean  MTF 
is  degraded  significantly  for  all  spatial  frequencies 


0.8 


♦  approximation 
O  actual  value 


0.*  - 

0 


Fig  12.  Elrror  introduced  by  separatini;  the  velocity  effects  from 
the  dynamic  MTF  when  not  justified. 


when  V  is  greater  than  ~0.5x.  This  can  also  be  seen  by- 
observing  the  roll-off  of  the  curves  in  Figs.  10-12. 

An  observation  of  the  static  MTF  graphs.  Figs.  8  and 
9,  reveals  that  wide  variations  in  the  MTF  of  CCDs 
occur  due  only  to  the  alignment  between  the  pixels  and 
image."  ®  Any  experimental  procedure  for  measuring 
the  performance  of  CCDs  must  recognize  this  wide 
variation.  The  three  MTF  curves,  maximum,  mini¬ 
mum,  and  mean,  are  the  most  important  values  for 
system  designers,  as  they  indicate  the  extremes  and 
the  expected  value  of  the  CCD  response.  Systems 
incorporating  CCDs  can  better  meet  specifications 
when  designers  have  this  more  complete  information 
about  device  response. 


Tabto  I.  CempartMn  ol  ttw  Actual  OynanUe  MTF  with  Itia  Oynamte  MTF 
Calculatad  !>y  (Mng  the  Vatodty  Saparstlon  Approilmatlor. 


r/ir 

a  “  d 

True  MTT 

“  0.7  T  7  ”  1  r.v  *  1 

Approximated  MTF 

Percent  error 

(%) 

0 

0.7764 

0.7764 

0.00 

0.05 

0.7755 

0.7756 

0.02 

0.10 

0.7727 

0.7732 

0.07 

0.15 

0.7682 

0.7693 

0.14 

0.20 

0.7618 

0.7637 

0.25 

0.25 

0.7537 

0.7566 

0.39 

0.30 

0.7439 

0.7480 

0.56 

0.35 

0.7324 

0.7379 

0.75 

0.40 

0.7193 

0.7263 

0.97 

0.45 

0.7049 

0.7134 

1.21 

0.50 

0.6889 

0  6990 

1.47 

0.55 

0.6716 

0.6834 

1.75 

0.60 

0.6532 

0.6665 

2.03 

0.65 

0.6336 

0.6484 

2.34 

0.70 

0.6129 

0.6292 

2.65 

0.75 

0.5913 

0.6089 

2.97 

0.80 

0.5689 

0.5876 

3.29 

0.85 

0.5458 

0.5654 

3.61 

0.90 

0.5220 

0.5424 

3.92 

0.95 

0.4976 

0.5187 

4.24 

1.00 

0.4728 

0.4943 

4.55 
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Fig.  13.  Mean  MTF  for  several  image  velocities. 


The  dynamic  MTF  graphs,  Figs.  10,  11,  and  13, 
display  the  effect  of  velocity  on  CCD  performance.  In 
all  cases,  the  MTF  is  reduced  significantly  by  image 
motion  for  ail  spatial  frequencies.  Figure  12  and  Ta¬ 
ble  I  show  conclusively  that  the  velocity  effect  is  not  in 
general  separable  from  the  overall  MTF  calculation. 
However,  for  low  velocities,  the  errors  introduced  by 
using  the  separation  approximation  of  Eq.  ( 1 7)  are  low. 
In  addition,  the  other  case  for  separability  mentioned 
in  Sec.  II  also  holds,  with  no  error  introduced. 


IV.  Conclusion 

This  work  has  shown  that  the  MTF  of  CCDs  de¬ 
pends  strongly  on  alignment  between  the  image  and 
the  CCD  pixels.  A  wide  range  of  MTF  values  is  possi¬ 
ble  for  any  given  spatial  frequency  input.  Designers 
should  have  complete  information  available  about  this 
variation  to  meet  specifications  of  imaging  systems 
incorporating  CCDs. 

In  addition,  this  work  has  shown  that  the  effect  of 
image  velocity  significantly  reduces  the  MTF  of  the 
static  case  for  all  spatial  frequencies  This  work  has 
also  shown  that  the  velocity  effect  is  not  separable 
from  the  general  MTF  expression.  However,  approxi¬ 
mating  the  true  MTF  with  a  separation  of  velocity 
terms  is  valid  for  only  two  special  cases. 
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Abstract.  The  concepts  of  dynamic  modulation  transfer  funaion  (DMTF) 
and  degree  of  degradation  (DD)  are  used  for  analyzing  gray  level  image 
display  of  a  phosphor  based  display  system.  Real-time  restoration  of  the 
motion-degraded  display  images  may  be  accomplished  using  one  or  more 
inverse  filters  whose  characteristics  depend  on  the  magnitude  and  direc¬ 
tion  of  the  motion.  Both  DMTF  and  DD  characteristics  are  used  in  the 
restoration  of  motion-degraded  images. 

Subject  terms:  electro-optical  displays;  dynamic  modulation  transfer  function;  mo¬ 
tion-degraded  displays;  inverse  filters;  impulse  response. 
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1.  INTRODUCTION 

Traditionally,  displays  are  evaluated  using  the  modulation  trans¬ 
fer  function  (MTF)  in  stationary  mode.'  However,  the  temporal 
response  of  an  imaging  system  is  expected  to  play  an  important 
role  in  the  degradation  of  dynamic  images.  The  absence  of  tem¬ 
poral  response  considerations  in  the  formulation  of  the  MTF 
limits  its  scope  in  analyzing  degraded  modulation  contrast,  es¬ 
pecially  at  higher  spatial  frequencies.*  This  shortcoming  of  the 
MTF  formulation  has  been  overcome  recently^  by  the  introduc¬ 
tion  of  a  newer  measure,  referred  to  as  the  dynamic  MTF  (DMTF). 
It  also  has  been  shown  that  the  DMTF  characteristics  can  be 
used  for  the  restoration  of  motion-degraded  display  images  in 
real  time. 

Another  recent  work"*  has  already  identified  several  inverse 
filter^  based  systems  (both  adaptive  and  nonadaptive)  for  the 
restoration  of  binary  degraded  images.  However,  most  of  the 
displayed  images  of  interest  are  nonbinary  in  character.  In  this 
paper,  we  extend  the  work  of  Ref.  4  by  exploring  the  capability 
of  real-time  restoration  schemes  in  processing  gray  level  images. 
For  better  quantitative  analysis,  a  newer  measure,  referred  to  as 
the  degree  of  degradation  (DD).  is  introduced.  Both  DD  and 
histograms  are  used  to  study  gray  level  degraded  images.  Finally, 
an  optimal  set  of  inverse  filters  is  identified  for  restoring  motion- 
degraded  display  images. 

2.  REVIEW  OF  DMTF 

By  incorporating  the  sense  of  time  and  space,  one  may  define 
a  three-dimensional  impulse  response^  *’  that  behaves  like  an 
impulse  function  in  both  space  and  time.  Using  linear  system 
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theory,  therefore,  the  output  image  g{x.y,i)  is  given  ii.  terms  of 
the  three-dimensional  impulse  response  hix.y.t)  by 

^(x.y.i)  =  lix.y.t)  •  hlx.y.t)  .  (I) 

where  Hx.y.t)  represents  the  input  image  and  the  astensk  denotes 
a  convolution  operation.  However,  for  an  object  moving  along 
the  x-y  plane  with  a  constant  velocity,  the  input  image  /(x.y.i) 
can  be  characterized  by  /(x-t-mr.  y  +  nt),  where  m  and  n  denote 
velocity  components  in  the  .r  and  y  directions,  respectively. 
Accordingly,  Eq.  (1)  can  be  rewritten  as 

g(x.y.t)  =  Hx  +  mt.  y  +  nt)  *  hix.y.l)  .  (2) 

Now.  by  taking  the  Fourier  transform  of  Eq.  (2),  one  gets 

Glu.v.f)  =  JJJ  ^(-r.y./)  expl  -jltdux  +  vy  +  ft)_  'xdydt  .  (3) 

where  u  and  v  are  the  respective  spatial  frequency  jomponents 
along  the  horizontal  and  vertical  directions  and  /  is  t.e  temporal 
frequency. 

^ovided  the  point  impulse  response  function  hix.  t)  can  be 
expressed  as  a  product  of  a  purely  spatial  function  l  d  purely 
temporal  function,  such  as 

hix.y.t)  =  j(x.y)A(f)  .  (4) 

Eq.  (3)  can  be  evaluated^  to  give 

Clu.v.f)  =  D{f)S{u.v)l(u.v)h(f-  urn  -  vn)  ,  (5) 

where  D(f),  S{u,v),  and  Hu.v)  are  the  dynamic  transfer  func¬ 
tion.  the  static  transfer  function,  and  the  input  spatial  spectrum, 
respectively.  The  overall  transfer  function,  dynamic  MTF.  is 
thus  given  by 

Hiu.v)  =  S(u.v)i  ,v)  ,  (6) 

where  D(u.v)  =  D(um  +  vn).  Equation  (6)  dictates  the  effect 
of  both  velocity  and  static  transfer  function  on  the  quality  of  the 
displayed  image.  Accordingly,  it  can  be  used  to  characterize  the 
motion-degraded  images  as  well. 

It  has  already  been  determined  that  phosphor  persistence  af- 
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fects  the  temporal  response  of  a  CRT  display.’  *  When  the  ob¬ 
jects  are  moving  very  fast,  the  phosphor  characteristics  of  the 
display  screen  cause  the  displayed  images  to  appear  blurred.  In 
particular,  image  tube  phosphor  characteristics  have  been  shown 
to  be  exponential  in  nature,  given  by^ 


where  t  is  the  time  constant  defined  as  the  duration  in  which 
the  phosphorescence  decays  to  1/e  of  its  maximum  value.  Taking 
the  Fourier  transform  of  (7),  the  dynamic  component  of  the 
DMTF  of  the  phosphor  screen  can  be  obtained: 

'*> 

By  definition,  therefore,  the  inverse  filter  is  given  by 


1D( /)]■'  =  1  +  2tt/t  .  (9) 

However,  to  estimate  (Z)(/)]” '.  one  needs  to  estimate  the  time 
constant  of  the  phosphors  used  in  the  electro-optical  display 
under  consideration.  One  may  make  use  of  the  fact  that  type 
P-1052  phosphor,  for  instance,  takes  20  ms  to  decay  to  10%  of 
its  maximum  value.  This  implies  that  the  corresponding  time 
constant  is  8.68  ms  (Ref.  4).  In  this  work,  for  simplicity,  we 
approximate  it  by  0.(X)8  s. 


3.  DEGREE  OF  DEGRADATION 

Using  the  concept  of  mean-square  deviation,  the  degree  of  deg¬ 
radation  of  an  N  X  M  image  can  be  defined  as 


DD  = 


,v  *» 

2  2  . 

1= I  /=■  I  ( 


-.1/2 


,vw 


(D,j  -  0„Y 


(10) 


where  D,,  is  a  parameter  of  the  degraded  image  measured  at 
location  {ij),  while  Ojj  is  an  identical  quantity  of  the  original 
image  measured  at  the  same  location.  For  example,  D,j  and  Otj 
both  can  be  gray  levels  at  location  {iJ}  of  the  degraded  and 
original  image,  respectively.  The  DD  measure  can  be  used  to 
quantify  the  extent  of  image  degradation. 

For  simplicity,  we  may  measure  the  intensity  function yix.v) 
of  the  original  image  and  intensity  function  g(x.y)  of  the  cor¬ 
responding  degraded  image.  The  corresponding  DD  may  be  re¬ 
ferred  to  as  the  zeroth-order  DD,  denoted  by  DDq.  Likewise, 
we  may  also  measure  the  first  derivative  f'ix.y)  of  the  original 
image  and  the  first  derivative  g't-r.y)  of  the  degraded  image. 
Accordingly,  f'ix.y)  and  g'ix.y)  can  be  used  to  evaluate  the 
first-order  DD.  denoted  by  DD| .  While  DDo  indicates  the  degree 
of  degradation  of  gray  levels  between  the  degraded  and  original 
images,  DDi  indicates  the  degree  of  degradation  of  the  gray- 
gradient  between  the  degraded  and  original  images. 

4.  SIMULATION  OF  IMAGE  DEGRADATION  AND 
RESTORATION 

In  this  work,  we  use  inverse  filters  to  restore  the  motion-degraded 
images.  The  actual  optical  implementation  of  an  inverse  filter 
would  involve  employing  either  a  hologram  or  a  spatial  light 
modulator  (SLM)  in  a  system  like  that  shown  in  Fig.  I. 


I - ^ - 1 - '■ - 

FILTH) 

Hg.  1.  Real-time  image  restoration  system. 


Fig.  2.  64x64  pixel,  16  gray  level  input. 

The  simulation  algorithm  for  obtaining  the  degraded  images 
involves  the  following  three  steps:  ( 1 )  Obtain  the  fast  Fourier 
transform  (FFT)  of  the  static  image.  (2)  Obtain  the  FFT  of  A(r). 

(3)  Take  the  inverse  FFT  of  the  product  (point  by  point)  of  the 
FFTs  obtained  in  steps  (1)  and  (2). 

The  restored  image  can  be  obtained  from  the  degraded  image 
in  accordance  with  the  following  four  steps:  ( 1 )  Obtain  the  FFT 
of  the  degraded  image  gix.y).  This  provides  S(u,v)D(f).  (2)  Given 
the  velocity  of  the  object  and  its  direction,  an  inverse  filter,  i.e. . 
(D(/)]''.  is  calculated.  (3)  The  results  obtained  in  steps  (1)  and 
(2)  are  multiplied  (point  by  point)  in  the  frequency  domain. 

(4)  Take  the  inverse  FFT  of  the  result  of  step  (3). 

Since  the  modulus  of  the  temporal  function  [D(/)]''  is  non¬ 
zero,  it  is  possible  to  have  a  perfect  recovery  of  the  input  image 
using  inverse  filters.  In  an  adaptive  restoration  system,  the  actual 
speed  Vo  needs  to  be  estimate  first  and  then  the  corresponding 
inverse  filter  needs  to  be  placed  at  the  Fourier  plane  of  the  optical 
system.  However,  the  estimation  of  the  value  and  direction  of 
motion  may  not  be  a  trivial  problem.  Alternatively,  therefore, 
we  devise  a  nonadaptive  scheme  whereby  a  preprocessed  inverse 
filter  (corresponding  to  velocity  V/  =  Vo)  may  already  be  placed 
at  the  Fourier  plane.  In  that  case,  both  the  digital  processor  and 
the  sensor  can  be  avoided  from  the  system  shown  in  Fig.  1. 
Depending  on  the  value  of  |V/  -  Fd,  therefore,  this  filter  may 
partially  restore  motion-degraded  displayed  images. 

A  64  x  64  pixel  undistorted  image  (having  16  gray  levels), 
as  shown  in  Fig.  2.  is  used  as  the  input  for  the  simulation.  Figure 
3  shows  the  degraded  images  when  the  displayed  input  images 
move  at  an  angle  of  45°  relative  to  the  x-axis  with  velocities  of 
2  cm/s  and  10  cm/s.  respectively.  One  can  see  that  both  the 
horizontal  and  vertical  edges  of  the  image  are  significantly  de- 
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Is)  lb)  (a)  (bi 

Fig.  3.  Degraded  images  caused  by  object  motions:  (a)  2  cm/s  and  Fig.  4.  Restored  images  of  the  input  of  Fig.  3(b)  using  inverse  fiber- 
(b)  10  cm/s.  corresponding  to  (a)  8  cm/s  and  (b)  12  cm/s. 


graded.  Figure  4  show,s  the  images  restored  from  that  of  Fig.  3(b) 
using  inverse  tillers  corresponding  to  velocities  of  8  cm/S  and 
12  cm/s,  respectively. 

Typical  curves  showing  the  variation  of  DDo  and  DD|  with 
object  velocity  V'„  are  shown  in  Fig.  5,  where  the  inverse  tiller 
used  was  particularly  designed  to  handle  a  velocity  value  of  Vf. 
From  Fig.  5,  we  see  that  both  DDn  and  DDi  increase  with 
increasing  V„.  This  implies  that  with  increasing  object  motion, 
the  displayed  image  will  be  degraded  more  and  more.  The  use 
of  a  restoration  tilter.  however,  reduces  the  value  of  both  DDo 
and  DD|.  With  V’l  approaching  V'„,  the  value  of  both  DDo  and 
DDi  approaches  zero.  In  the  limiting  case,  the  motion  degra¬ 
dation  of  an  image  can  be  totally  eliminated.  W/ith  increasing 
IVV  -  V’.il.  both  DDo  and  DD|  increase.  The  smaller  the  difference 
between  I’,,  and  VV.  the  smaller  the  degeneration  of  the  displayed 
image.  It  may  be  noted,  however,  that  the  distnbutions  of  both 
DDo  and  DDi  are  not  necessarily  symmetric  about  the  ptnnt  of 
the  minimum  value. 

To  e.xtract  additional  information  about  the  image,  one  can 
make  u.se  of  a  histogram.  For  example.  Fig.  6(al  shows  the 
histogram  of  the  ongmal  image,  while  Figs.  b(b)  through  6(d) 
show  degraded  images  when  the  displayed  ongmal  moves  with 
a  veliK'ity  of  6,  1 2.  and  I6  cm/s.  It  can  be  concluded  that  the 
average  gray  level  value  decreases  with  increasing  object  ve¬ 
locity.  .\s  per  Eq.  (5). /is  proportional  to  a  linear  combination 
of  m  and  n.  This  implies  that  D{  /)  decreases  with  increasing 
m  and  n  |per  Eq.  (8)|.  which  in  turn  indicates  that  the  average 
gray  level  value  of  the  restored  image  decreases  w  ith  increasing  V„. 

From  the  histograms  of  Fig.  7.  however,  one  may  conclude 
that  with  increasing  (when  V„  is  fixed),  the  average  gray  level 
value  of  the  restored  image  mcrea.ses.  Figure  8  shows  the  his¬ 
tograms  of  the  restored  image  (using  a  tiller  corrcsptinding  to 
Vf  =  lO  cm/s)  obtained  from  image  degraded  by  object  motion. 
One  may  conclude  from  Fig.  ,S  that  with  increasing  V’„  (for  a 
fixed  value  of  V',  ).  the  average  gray  level  value  of  the  restored 
image  decreases. 

5.  idf:ntification  of  the  optimal 

RESTORATIO.N  FILTER 

It  is  first  necessary  to  determine  the  extent  of  the  object  veliKitv 
for  the  application  under  consideration.  Here,  for  illustration, 
we  chose  an  image  mtensitier  tube,  such  as  that  used  in  night- 
vision  goggles.  For  such  applications,  it  can  be  estimated"*  that 
the  maximum  spatial  speed  rn  can  be  16  cm/s.  Note  that  this 
speed  refers  to  the  speed  at  which  the  image  appears  to  move 


Fig.  S.  DDo  and  DDi  characteristics  with  and  without  a  restoration 
filter  (corresponding  to  Vt  =  10  cm/s). 

on  the  surface  of  the  display  The  actual  speed  of  the  target, 
depending  on  its  location,  may  be  far  greater. 

•An  inverse  filter  based  on  a  not-so-accuraie  estimation  of 
veltKity  can  be  used  to  reasonably  restore  the  motion-degraded 
images.  Accordingly,  it  may  be  possible  to  identify  onlv  one  or 
a  set  of  a  few  optimum  inverse  filters  for  the  restoration  of 
displayed  images  of  objects.  The  degree  of  degradation  can  be 
used  for  identifying  the  optimum  inverse  hlter. 

The  algonthm  for  identifying  the  optimum  inverse  filter  con¬ 
sists  of  the  following  steps:  ( 1)  Determine  the  maximum  allow  ¬ 
able  value  of  DDi).  (2)  Obtain  a  family  of  DDo-V,.  curves.  1 3)  Fmm 
the  family  of  curves,  select  the  set(s)  of  DD,i-V,,  curves  that  can 
account  for  the  total  extent  of  V'„  and.  at  the  same  time,  satislv 
the  constraint  of  the  maximum  allowable  DDn.  (4)  Companng 
the  sets  of  curves  obtained  in  step  (3).  chtxise  the  one  that 
involves  the  least  number  of  filters  and  the  lowest  value  of  DD.i. 

For  example.  Fig.  4  shows  DDo  charactenstics  tor  two  ot  the 
restoration  hlters  correspvmding  to  V,  =  6  eras  and  14  cm  s 
Provided  that  30  (in  arbitrary  units)  has  been  determined  as  the 
maximum  tolerable  value  of  DDo.  these  two  filters  mav  be  used 
to  form  a  composite  inverse  tilter  for  real-time  restoration  of  the 
corresponding  motion-degraded  displayed  images.  .Alterna¬ 
tively,  the  u.ser  could  switch  between  these  niters  until  ihc  dis¬ 
played  image  appears  acceptable 
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RESTORATION  OF  DYNAMICALLY  DEGRADED  GRAY  LEVEL  IMAGES  IN  PHOSPHOR  BASED  DISPLAY  DEVICES 
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^g.  6.  Histograms  of  (a)  the  original  image  and  degraded  images 
caused  by  a  motion  of  (b)  6  cm/s,  (c)  12  cm/s,  and  (d)  16  cm/s. 


It  should  be  noted  that  DD|  indicates  the  extent  of  degradation 
in  the  distribution  of  the  gray  gradient.  Thus,  c’epending  on  the 
application,  one  can  use  DD|  also  as  a  criterion  (instead  of  DDo) 
for  the  determination  of  the  optimum  inverse  filter.  In  fact,  by 
taking  both  DDo  and  DDi  into  consideration,  a  more  optimail 
inverse  filter  can  be  identified. 

For  example.  Fig.  10  sho\vs  two  motion-degraded  images  of 
the  object  of  Fig.  2  with  respective  DD|  values  of  4.07  and 
7. 19.  Obviously,  the  latter  display  has  a  more  degenerated  dis¬ 
tribution  of  gray  levels.  When  the  high  frequency  components 
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Fig.  7.  Histograms  of  image  restored  (originally  degraded  by  a  mo¬ 
tion  of  10  cm/s)  using  inverse  filters  corresponding  to  (a)  2  cm/s, 
(b)  8  cm/s,  and  (c)  16  cm/s. 


of  an  object  need  to  be  emphasized.  DD|  will  play  a  more 
powerful  role  than  DDo.  However.  DD|  plays  an  insignificant 
role  in  the  analysis  of  binary  images.  Since  a  gray  level  display 
offers  better  detail  than  the  binary  image  displays.  DD|  is  ex¬ 
pected  to  be  used  more  often  in  the  characterization  of  image 
restoring  filters. 


6.  CONCLUSIONS 

The  DMTF  is  a  powerful  tool  for  the  analysis  of  a  dynamic 
optical  imaging  system.  The  separable  type  of  DMTF.  consid¬ 
ered  herein,  is  of  the  simplest  form.  In  general,  an  imaging 
system  may  have  a  significandy  more  complex  form  of  the  DMTF. 
The  DMTF  also  serves  as  a  tool  in  the  synthesis  of  optical 
systems.  The  design  of  systems  that  can  be  used  for  restoring 
the  motion-degraded  displayed  images,  using  both  the  DMTF 
and  the  degree  of  degr^tion.  is  just  an  example  of  such  a 
system  synthesis.  In  this  paper,  we  have  developed  a  scheme 
for  identifying  an  optimum  set  of  inverse  filters  for  implementing 
a  real-time  image  restoration  system. 
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Hg.  9.  DOo  characteristics  versus  degradation  motion  for  a  resto¬ 
ration  filtar  corresponding  to  0  cni/s.  6  cm/s.  and  14  cm/s. 


(a)  (b) 


Rg.  10.  Restored  images  having  DDi  values  of  (a)  4.07  and  (b)  7.19. 


Rg.  8.  Histograms  af  >.  'ora  restored  using  an  inverse  filtar  (corre¬ 
sponding  to  10  cm/s)  from  images  degraded  by  motion  of  (a)  6 
cm/s,  (b)  12  cm/s,  and  (c)  16  cm/s. 
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Abstract.  The  modulation  transfer  function  (MTF)  and  contrast  transfer 
function  (CTF)  are  considered  for  discrete  systems.  The  MTF  and  CTF  are 
derived  for  the  charge-coupled  device  (CCD).  The  analysis  presented  con¬ 
siders  the  full  effects  of  sampling  on  device  response.  Experimental  tests 
of  the  CTF  for  a  line-array  CCD  are  presented.  The  MTF  and  CTF  are  shown 
to  be  multivalued  functions  for  discrete  systems. 

Subject  terms:  electro-optical  displays;  modulation  transfer  function:  contrast  transfer 
function;  charge-coupled  devices;  sampling. 
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1.  INTRODUCTION 

The  charge-coupled  device  (CCD)  is  a  very  versatile  imaging 
device. '  CCDs  have  a  number  of  advantages  over  other  imaging 
devices  and  in  recent  years  have  been  incorporated  in  a  wide 
range  of  electro-optic  systems.*  It  is  important,  therefore,  to 
acquire  a  detailed  understanding  of  the  characteristics  and  lim¬ 
itations  of  CCDs  as  imaging  devices,  particularly  their  spatial 
frequency  response. 

Characterization  methods  for  continuous  optical  devices,  such 
as  the  modulation  transfer  function  (MTF)  and  contrast  transfer 
function  (CTF),  have  proved  to  be  very  useful  techniques.  It  is 
desirable  to  have  compatible  methods  for  analyzing  discrete  de¬ 
vices  such  as  CCDs.  Previous  attempts  to  apply  the  MTF  and 
CTF  to  discrete  devices  have  had  mixed  success.^  The  MTF  and 
CTF  assume  a  linear,  space-invariant  and  time-invariant  system. 
While  CCDs  are  linear  within  an  operating  range,  they  are  not 
space  invariant  because  they  have  fixed  sampling  locations. 
Characterization  methods  for  discrete  devices  must  consistently 
4pply  sampling  theory,  which  previously  has  not  been  done. 
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The  MTF  and  CTF  arc  commonly  used  to  analyze  the  spatial 
frequency  response  of  optical  devices  because  they  can  be  cas¬ 
caded  in  a  system:  the  total  MTF  or  CTF  of  a  system  is  equal 
to  the  product  of  the  MTFs  or  CTFs,  respectively,  of  the  system 
components.  This  work  concentrates  on  applying  the  MTF  and 
CTF  to  CCD  behavior  so  that  overall  behavior  of  systems  in¬ 
corporating  CCDs  can  be  analyzed  consistently. 

Although  the  MTF  is  simpler  to  calculate  in  theory  than  the 
CTF,  experimental  work  is  dmost  always  done  with  the  CTF. 
CTF  analysis  can  be  implemented  with  simpler  equipment,  and 
CTF  results  for  continuous  systems  can  be  mathematically  ma¬ 
nipulated  to  acquire  the  appropriate  MTF  values.'* 

This  work  presents  the  sampling  analysis  necessary  for  a  more 
complete  understanding  of  the  behavior  of  discrete  optical  de¬ 
vices  in  general  and  CCDs  in  particular,  as  well  as  experimental 
work  to  verify  this  behavior.  The  MTF  and  CTF  will  be  used 
to  analyze  the  spatial  frequency  response  of  ideal  CCDs.  The 
theoretical  response  of  the  CCD  for  the  two  functions  will  be 
derived,  and  the  experimental  CTF  will  be  measured.  The  re¬ 
sultant  information  will  allow  more  accurate  design  of  systems 
incorporating  discrete  devices  such  as  CCDs. 

The  discussion  centers  on  mathematically  describing  the  be¬ 
havior  of  CCDs  in  detail,  particularly  the  effects  of  sampling. 
The  MTF  and  CTF  input  images  will  be  applied  to  a  mathe¬ 
matical  model  of  ideal  linear  CCD  pixels  to  predict  the  MTF 
and  CTF  results.  The  experimental  discussion  describes  the  re¬ 
sults  of  illuminating  a  line-array  CCD  with  the  CTF  input  image 
at  several  frequencies. 

2.  CCDs 

The  CCD  was  developed  by  Boyle  and  Smith  in  1970.'  CCDs 
can  be  used  in  purely  electronic  applications  such  as  shift  reg¬ 
isters  but  are  most  conrunonly  used  for  imaging.  This  work  is 
concerned  exclusively  with  CCDs  as  imaging  devices. 

CCDs  are  typically  fabricated  with  metal-oxide  semicon¬ 
ductor  silicon  technology  on  a  p-type  substrate  with  an  n-type 
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Fig.  1.  CCO  potmtial  walls  formed  by  a  high  voltage  on  line  B. 
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active  layer.  Each  pixel  is  connected  to  several  address  lines, 
which  create  potential  wells  in  the  CCD  substrate.  Figure  1 
illustrates  this:  line  B  has  a  higher  voltage  than  lines  A  and  C, 
forming  one  potential  well  in  the  center  of  each  pixel.  Photoelec¬ 
trons  are  collected  in  the  potential  wells,  with  the  electron  content 
of  a  well  equal  to  the  time  and  space  integral  of  the  incident 
radiation  as  modified  by  the  quantum  efficiency  of  the  CCD 
material.^ 

A  clocking  scheme  controls  the  photoelectron  collection.  Dur¬ 
ing  the  charge  integration  interval,  electrons  are  collected  and 
stored  in  the  potential  wells.  During  the  charge  transfer  interval, 
the  electron  packets  are  transferred  to  the  CCD  output.  By  at¬ 
taching  the  address  lines  to  different  phases  of  a  high-frequency 
clock,  the  potential  wells  and  their  charge  packets  are  quickly 
moved  across  the  CCD,  as  shown  in  Fig.  2. 

This  work  examines  two  of  the  more  common  geometries 
used  in  CCDs,  the  frame  transfer  CCD  (FT  CCD)  and  the  in¬ 
terline  transfer  CCD  (IT  CCD).  The  significant  difference  be¬ 
tween  the  two  geometries  for  this  discussion  is  the  relationship 
between  pixel  width  and  pixel  pitch.  Pixel  width  is  the  si/e  of 
the  active  portion  of  the  pixel  capable  of  creating  and  collecting 
photoelectrons  in  a  potential  well.  Pixel  pitch,  or  pixel  spacing, 
is  the  distance  between  the  centers  of  adjacent  pixels.  FT  CCD 
pixels  have  approximately  equal  pixel  width  and  pixel  pitch 
along  both  array  axes.  IT  CCD  pixels  have  approximately  equal 
pixel  width  and  pixel  pitch  along  one  axis  and  have  a  pixel  width 
approximately  equal  to  one-half  the  pixel  pitch  along  the  other 
axis. 

A  number  of  CCD  noise  conditions  and  honlinearities  have 
been  analyzed  previously,^  such  as  incomplete  charge  transfer, 
blooming,  smearing,  thermal  noise,  and  deep-IR  electrons.  Man¬ 
ufacturers  of  CCDs  have  developed  a  number  of  fabrication  and 
packaging  methods  to  reduce  the  effects  of  these  phenomena, 
and  they  are  not  discussed  further  in  this  work. 


Fig.  3.  Unc-array  static  MTF  paramatars. 


3.  MTF  AND  CTF  DERIVATION 

This  section  develops  the  mathematics  for  the  MTF  and  CTF  oi 
discrete  systems  and  discusses  the  results.  CCD  pixels  are  as 
sumed  to  be  ideal,  with  identical  uniform  response  in  time  anc 
space  and  a  regular  rectangular  geometry.  In  addition,  the  noist 
conditions  referred  to  in  the  previous  section  are  ignored. 

3.1.  MTF  derivadon 

The  MTF  is  first  calculated  for  the  one-dimensional  static  case 
i.e.,  a  line-array  CCD  and  a  stationary  input  image.  The  cal¬ 
culation  is  then  modified  to  handle  image  motion  with  a  constan: 
velocity  within  ore  scan  interval  and  is  further  modified  to  handk 
oblique  images  on  an  area-array  CCD.  The  reader  is  referred  tc 
an  earlier  work*^  for  a  more  detailed  explanation  of  the  parameter 
used  in  the  calculations  below. 

The  MTF  input  function  is'* 

/  =  '/2(1  +  cos(r))  .  (! 


Equation  (1)  gives  the  CCD  photoelectron  creation  rate.  The 
MTF  is  defined  by  the  response  of  the  CCD'*  as 


MTF  = 


~  ^mio 
BmMX  "F  ^mio 


(2) 


where  Bmax  and  Bmn  are  the  values,  in  any  appropriate  units, 
of  a  neighboring  maximum  and  minimum  of  the  output.  For 
CCDs,  and  Smin  will  be  the  output  of  'wo  specific  pixels, 
usually  in  volts. 

Figure  3  illustrates  the  following  parameters  (all  of  which  are 
measured  in  millimeters):  T — period  of  the  input  pattern,  Tn — 
Nyquist  period  of  the  input.  Ta — CCD  pixel  active  width,  and 
Tp-^CD  pixel  pitch. 

The  pixel  width  and  pixel  spacing  are  normalized  as 


a 


Tn  ' 


(3) 


(4) 


The  alignment  between  the  CCD  pixels  and  the  input  pattern  is 
important  in  calc"!aring  the  MTF.^  Figure  4  illustrates  the  fol¬ 
lowing  alignment  parameters  (both  of  which  are  measured  in 
radians):  i|»h— offset  between  a  maximum  of  the  input  pattern 
and  the  center  of  the  nearest  pixel,  and  ilit — offset  between  a 
minimum  of  the  input  pattern  and  the  center  of  the  nearest  pixel. 
These  parameters  are  limited  by 


894  OPTICAL  ENGINEERING  /  August  1 990  /  Vol.  29  No  8 


development  of  the  modulation  transfer  function  and  contrast  transfer  functjon  for  discrete  systems,  particularly 

CHARGE-COUPLED  DEVICES 


♦h  >  0  ♦l  *  ° 


Hg.  4.  MTF  alignment  parametara  i|ih  and  <|it. 

^  ^  f  .  (5) 

^  « I .  (6) 

If  a  pixel  generates  Bmu,  i  e.,  is  a  local  maximum,  there  are  in 
general  two  pixels  that  could  generate  Bmm-  The  critical  offset 
is  defined  to  be  the  value  of  such  that  the  minimum  of 
the  input  pattern  lies  at  the  boundary  of  two  pixels.  The  pixel 
index  n  is  given  by 


where  Int(x)  returns  the  integer  part  of  x  so  that 

J/jJ  =  -rr  -  (n  —  Vz)^  .  (8) 


Tlaa 


>  0  <  0  ® 


Rg.  5.  Offaat  parametara  for  the  dynamic  MTF. 

2»(f)  COS(ll»«) 

MTF  =  -  .  (14) 

a 

This  simplification  occurs  only  when  Tv/Tp  is  an  integer. 

To  incorporate  linear  motion  in  the  MTF,’  the  following 
additional  terms  are  defined: 

V — image  velocity  (millimeters/second),  y — CCD  charge  in¬ 
tegration  interval  (seconds),  and  8 — CCD  scan  interval  (sec¬ 
onds).  The  normalized  velocity  v  (radians/second)  is  defined  as 

V 

V  =  IT—  (15) 

Ts 

The  input  image,  Eq.  (1),  is  now 

/  =  1/2(1  +  cos(r  -  vf)]  .  (16) 


Using  n  and  »i<^,  <ifL  becomes 
'I'i  =  '1»«  +  . 


Figure  5  illustrates  the  new  alignment  parameters. 

Using  Eq.  (16),  the  MTF  for  the  dynamic  line-array  device 
becomes 


where 


n.  4ih  ^  <iiH  ’ 

n-  1,  tj»/y  >  il(;j  . 


MTF  = 


sin^°jsin^^j(cos(i|>H)  +  cos(i|(w  -t-  *D)) 

^  +  sin^^^sin^Y^(cos(«)»«)  +  cos(i|(/i<  -t-  *D)| 


Using  Eq.  (1),  B  maA  and  Bmm  are 
*^  +  (0/2) 

=  I  '/2(1  +  COS(5)]<ir  , 
— (0/2) 

ii»^  +  (0/2) 

flmm  =  I  '/2[1  +  COS(5)ldi 
-(0/2) 


(11) 


(12) 


Evaluating  and  substituting  into  Eq.  (2),  the  MTF  is 


sinj  -  1  cos(i(»/f)  -  cos(»|>«  -i-  tp) 


MTF  = 


sin(^)  CO! 


COSCtllff)  +  COS(»|lH  +  tp)  I 


Equation  (13)  simplifies  if  /tp  =  tt,  so  i(>/.  -  =  ir  from  Eq. 

(9).  The  MTF  of  Eq.  (13)  reduces  to 


When  V  =  0,  Eq.  (17)  degenerates  to  the  static  expression  of 
Eq.  (13). 

The  spatial  and  temporal  responses  of  imaging  systems  cannot 
be  separated  under  all  conditions.^  Separation  is  not  valid  for 
discrete  devices  because  of  their  space/time  variance.  Equation 
(17)  verifies  this  since  it  is  not  possible  to  separate  out  the 
velocity  terms. 

Two  special  cases  exist,  however,  in  which  separation  of  a 
velocity  Unction  gives  a  good  approximation  to  the  true  MTF 
value.  The  first  case  occurs  when  vyJ2  is  small,  and  the  second 
occurs  when  Ts/T^  is  an  integer.  If  MTFjui  is  the  MTF  evaluated 
without  any  velocity  effects,  as  in  Eq.  (13)  or  Eq.  (14),  the 
MTF  for  either  special  case  can  be  given  by 


MTF 


sin(v7/2) 

vyl2 


MTF,«  . 


(18) 


An  area-array  CCD  with  an  oblique  image  is  illustrated  in 
Fig.  6.  The  input  image  is  oriented  at  an  angle  0^;  with  no 
motion  it  is  given  as 
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Fig.  6.  ArM'array  MTF  paramatara. 


/  =  1/2[1  +  cos(5p)]  .  (19) 

where  Sp  is  a  generalized  spatial  parameter,  oriented  at  an  angle 
6p  to  the  CCD  x  axis.  To  evaluate  the  MTF  along  either  of  the 
two  pixel  axes,  Sp  is  resolved  into  two  components,  Sx  and  Sy, 
as 

Sp  =  j,cos(0p)  +  rysin(0p)  .  (20) 

For  the  case  of  image  motion,  the  image  moves  with  a  velocity 

V  at  an  angle  0,„.  V  is  normalized  as 

V 

V  =  IT—  (21) 

‘N 

It  is  necessary  to  find  the  projection  of  the  velocity  along  the 
image  itself.  Accordingly,  the  projected  velocity  Vp  is  defined 


To  determine  MTF»,  the  alignment  vanables  iIih,  >i(i,  iji«,  n, 
and  k  are  defined  at  the  center  of  the  pixel  with  respect  to  the 
y  dimension  and  the  time  dimension,  i.e..  at  jy  =0  and  t  = 
0.  For  MTFy.  the  alignment  vanables  are  defined  at  the  center 
of  the  pixel  with  respect  to  the  x  dimension  and  the  time  di¬ 
mension.  The  pixel  index  n  and  critical  offset  iliw  for  the  MTF, 
calculation  are 


rg,cos(0p) 


«1»«  =  IT  -  (n  -  '/2)3,  , 

and  for  the  MTFy  calculation  are 
[reySim0;,)J 


|J<H  =  IT  -  (m  -  '/l)3y  .  (30) 

flmw  and  Bmin  are  triple  integrals.  When  evaluated  and  sub¬ 
stituted  into  Eq.  (2),  MTF,  is 

MTF,  = 


*'"(?)  ‘^°*'**''*^  ~  cosnli«  +  *0.) 

/a,\  ,  /a.X  /vy\r 

— " —  *'"(  T /  *'"(  T /  ~ cos(>li»  -  *3.) 


.  (31) 


MTFv  is  calculated  similarlv; 


Vp  =  vcos(0„  -  0p)  .  (22) 

The  physical  dimensions  of  the  CCD  are  normalized  in  a  manner 
similar  to  that  of  the  line-arrav  case: 


a,  =  cos(0p)T 


P,  =  cos(0p)ir-^ 
is 


ttv  =  sin(0„)T 


T 

Py  =  sin'0p)ii^  ,  (26) 

In 

For  any  rectangular  device,  the  MTF  can  be  calculated  in 
either  of  two  orthogonal  directions,  corresponding  to  the  x  and 
y  pixel  axes.  MTF,  is  the  MTF  calculated  by  progressing  in  the 
X  direction  from  a  maximum  to  an  adjacent  minimum:  MTFy  is 
calculated  by  progressing  in  the  y  direction.  The  MTF  deriva¬ 
tions  are  similar. 


sin(-^)  ~  cos(iJ;«  +  *0,) 

- ^ - -  (32) 

*0y)j 

Equations  (31)  and  (32).  the  expressions  for  the  MTF  along 
either  axis  of  a  two-dimensional  array  of  pixels,  are  the  most 
general  form  of  the  work  in  this  section.  Equations  (31)  and  (32) 
degenerate  to  all  simpler  forms  of  the  MTT  discussed  earlier. 

3.2.  CTF  derivation 

The  CTF  is  more  difficult  to  calculate  analytically  than  is  the 
MTF  because  it  involves  integrals  exclusively  of  square  waves. 
The  limits  of  integration  are  determined  by  the  positions  of  the 
image  edges  and  pixel  edges,  and  they  completely  determine 
the  integration  results.  For  this  reason,  the  results  below  are  not 
so  much  an  equation  for  the  CTF  as  they  are  an  algorithm  for 
applying  several  equations  to  the  CTF  cdculation. 

The  derivation  below  is  for  the  case  of  a  line-array  CCD  with 
image  motion.  Derivation  of  CTF  results  for  an  area-array  CCD 
proved  to  be  too  lengthy  for  the  scope  of  this  work  but  will  be 
a  logical  extension  of  the  methods  presented  here. 

The  input  image  for  the  CTF  is  a  raised  square  wave.  The 
CTF  is  calculated  as 
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Fig.  7.  Static  CTF  calculations. 


CTF 


Bmtx  ~  B  min 
BmMX  "F  ^imn 


(33) 


where  Anux  and  fimm  are  the  values,  in  any  appropriate  units, 
of  a  neighboring  maximum  and  minimum  of  the  output.  For 
CCDs.  Bmax  and  flmin  will  be  the  output  of  two  specific  pixels, 
usually  in  volts. 

The  parameter  definitions  for  the  CTF  are  the  same  as  those 
for  the  MTF.  The  normalized  variables  are 


a 


■nTg 
Ts  ' 


|3  = 


lie 

■ 


(34) 

(35) 


The  offset  parameters  ili//,  n,  and  k  apply  to  the  CTF 

as  they  do  for  the  MTF. 

Figure  7  shows  the  simplest  case,  which  occurs  when  there 
is  no  image  motion.  and  can  be  calculated  from  the 
arrangement  of  pixel  edges  and  image  edges  as 


a  ir 

a  7T 

Min 

-  Max  2  ’ 

B 


min 


a  -  Min 


+  Max 


(37) 


where  Maxfx.y)  returns  the  greater  of  x  and  y  and  Minfx.y] 
returns  the  lesser  of  x  and  y.  Equation  (33)  can  be  evaluated 
with  Eqs.  (36)  and  (37)  to  determine  the  CTF  for  the  static  case. 

Bmax  and  Bmm  become  much  more  complicated  if  the  image 
has  velocity.  Figure  8  shows  the  possible  pixel  conditions  for 
finding  Bmax,  where  the  image  velocity  is  restricted  to  a  positive 
sign  for  convenience.  The  expression  for  Bmax  in  this  case  is 

Bmax  ~  cry  —  (ULmu)  “  (1-Rm**)  .  (38) 

where  ULm«  and  LR^ax  are  the  cross-hatched  comer  portions 
of  a  pixel,  identified  in  Fig.  8  as  the  upper  left  and  lower  right. 
These  portions  are  not  covered  by  the  input  image  maximum. 
It  is  cautioned  that  “upper  left”  and  “lower  right”  are  not 
indications  of  spatial  arrangement:  upper  and  lower  refer  to  the 
time  dimension,  and  left  and  right  refer  to  space.  The  terms 
upper  left  and  lower  right  are  used  only  for  convenience  in 
visualizing  the  problem  and  in  referring  to  Fig.  8.  The  expression 
for  Bmin  is  similar  to  that  for  Bmax^ 

^min  “  (UU,„)  +  (LR™„)  .  (39) 


Rg.  8.  Dynamic  CTF  calculatlona. 

ULmax.  LRnux.  ULmrn.  and  LRnun  Can  each  have  one  of  three 
possible  forms:  0 — complete  coverage  of  the  pixel  comer  by 
appropriate  pan  of  the  input  image,  B(HI2) — triangle  with  base 
B  and  height  H  not  covered  by  the  appropriate  part  of  the  input 
image,  and  (Bi  +  Bt)(HH) — trapezoid  with  bases  B\  and  Bi 
and  height  H  not  covered  by  the  appropriate  part  of  the  input 
image.  Finding  the  comer  contributions  UUtux,  LRm»x.  ULnun, 
and  LRmin  is  now  the  chief  problem.  The  calculation  of  ULmxx 
will  be  representative  of  the  others  and  will  be  examined  in  the 
most  detail. 

The  charge  integration  interval  ends  when  t  =  y/2.  At  this 
time,  the  low-to-high  transition  or  left  edge  of  the  square  wave 
occurs  at  s  =  -  it/2  +  vy/2.  and  the  left  edge  of  the  pixel  lies 
at  s  =  ijiH  -  a/2 .  The  variable  u  is  defined  to  be  their  difference; 


If  u  is  less  than  or  equal  to  0.  the  upper  left  portion  of  the  pixel 
is  completely  covered  by  the  input  image,  and  so  ULmax  is  zero. 
If  u  is  greater  than  0.  another  criterion  must  be  found  to  distin¬ 
guish  between  the  two  remaining  forms  for  ULmax.  the  triangle 
and  the  trapezoid.  Dividing  «  by  v  gives  the  time  interval  before 
the  end  of  the  charge  integration  interval,  i.e..  the  displacement 
down  from  the  top  left  comer  of  the  pixel  in  Fig.  8.  when  the 
left  edge  of  the  input  pattern  crosses  the  left  edge  of  the  pixel. 
If  this  interval  is  less  than  the  charge  integration  interval  y,  then 
ULmax  is  evaluated  using  the  triangle  formulation.  Otherwise, 
the  trapezoid  is  used. 

The  expression  for  ULmax  for  the  triangle  form  is 


BH  (ii)(m/v)  u' 
~  2  ~  2  "  2v 


(41) 


To  find  the  expression  for  ULmax  for  the  trapezoid  form,  let  w 
be  defined  as 

which  is  similar  to  the  expression  for  u.  The  two  bases  of  the 
trapezoid  are  now  equal  to  u  and  w.  The  expression  for  ULmax 
for  trapezoid  form  is  thus 


where  ULmm  and  LRmm  are  the  cross-hatched  comer  portions  , ,,  ,  d  ,  d  .  ,1 

not  covered  by  the  input  image  minimum.  2  2 


rntr*ifcircntMr)  ''-i  n  nn'i 


FELTZ 


The  algorithm  for  determining  ULmu  can  be  stated  succinctly 
as  follows: 


IF  (u  «  0)  THEN 
UL™.  =  0 

ELSE  IF  (uJv  ^  y)  THEN 


(44) 


UL™,  =  - 
2v 


(45) 


ELSE 

ULm»,  =  (tt  + 

END 

Similar  algonthms  for  LRma*.  ULmm.  and  LRmm  are  as  follows: 
LRimut 


(46) 


(47) 


IF  (u  «  0)  THEN 
“  0 

ELSE  IF  (w/v  -y)  THEN 
LR 


(48) 


2v 

ELSE 

W  =  (^H  + 


LRfnM  ~  ( M  +  ^ 


END 

ULmint 


(49) 

(50) 

(51) 


IF  (u  «  0)  THEN 
UL„,„.  =  0 

ELSE  IF  («/v  «  7)  THEN 


(52) 


UL™,  =  - 

2i' 


ELSE 


UL„u„  =  (u  + 
END 

LRm^I 


(53) 


(54) 


(55) 


IF  (a  =s  0)  THEN 
LR™„  =  0 

ELSE  IF  (uJv  <  7)  THEN 


(56) 


LRimn  ~ 


ELSE 


2v 


LRmm  -  (U  + 


END 


(57) 


(58) 


(59) 


These  algorithms  give  the  necessary  information  for  calculating 
the  dynamic  CTF  by  using  Eqs.  (33).  (38),  and  (39). 


3.3.  Discussion  of  theoretical  results 

Figures  9  and  10  show  typical  MTF  curves  as  a  function  of  ili//. 
Figure  9  shows  the  MTF  of  a  line-array  device  with  Ta  =  = 

OJTn  and  no  image  motion,  while  Fig.  10  shows  MTF,  for  an 
area-array  device  with  ZTa,  =  Tp,  =  0.87^,  Tay  =  Tpy  = 
0.6T/V.  9p  =  45°.  and  Vpy  =  O.Sir.  These  results  are  calcu¬ 
lated  by  allowing  ij>«  to  vary  from  -  p/2  to  p/2  with  a  step  size 
of  p/100.  Note  that  the  minimum  of  each  curve  occurs  where 
"I'M  =  where  the  slope  of  the  curve  is  discontinuous. 

Figures  1 1  and  12  show  the  MTF  of  a  line-array  device  as  a 
function  of  spatial  frequency  fOT  the  cases  fa  =  TpandZTa  =  Tp, 
respectively,  with  no  image  velocity.  Any  hfTF  value  between 
the  two  extreme  curves  on  the  graphs  is  possible,  with  the  mean 
values  represented  by  the  central  curves.  The  data  points  for  the 
maximum  curve  are  obtained  by  searching  the  MTF  values  gen¬ 
erated  at  each  spatial  frequency.  The  data  points  for  the  minimum 
MTF  curve  are  obtained  by  evaluating  the  MTF  at  »1»«  =  »1»JJ 
for  each  spatial  frequency.  The  data  points  for  the  mean  MTF 
curve  are  obtained  by  perf^orming  an  arithmetic  mean  of  the  data 
generated  at  each  spatial  frequency.  This  mean  calculation  is 
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MTF 


Rg.  9.  Variation  in  MTF  dua  to  offset  i|(m  for  tha  static  lina-array 
case. 


MTF 

X 


Fig.  10.  Variation  in  MTF  duo  to  offset  i|(m  for  tha  dynamic  area-array 
case. 

justified  because  any  offset  in  the  range  -p/2  to  p/2  is 
equally  likely  for  an  input  image  in  actual  use.  The  upper  limit 
on  normalized  spatial  fiequency  is  it,  which  corresponds  to  the 
Nyquist  sampling  limit  of  the  CCD. 

Figures  1 1  and  12  are  important  results  because  they  are  the 
ideal  static  MTF  responses  for  the  two  geometries  discussed  in 
Sec.  2.  Figure  11  shows  the  static  MTF  calculated  for  either 
dimension  of  an  FT  CCD  or  for  the  dimension  parallel  to  the 
charge  transfer  paths  of  an  FT  CCD.  Figure  12  shows  the  static 


MTT 


Fig.  11.  Static  lina-array  MTF.  T.  = 


MTF 


■  \i 

0.0  - - - - ^ - » 

0.0  u/2  r 


P 

Fig.  12.  Static  lina-array  MTF,  2T„  =  Tg. 


MTF  calculated  for  the  dimension  orthogonal  to  the  charge  trans¬ 
fer  paths  of  an  IT  CCD. 

Figure  1 3  shows  the  mean  MTF  of  a  line-array  device  as  a 
function  of  frequency  for  Ta  =  Tp  for  several  velocities.  Notice 
that  even  at  low  frequencies,  the  MTF  is  seriously  degraded  by 
a  moving  image.  Figure  14  shows  the  MTF  of  a  line-array  device 
as  a  function  of  velocity  for  Ta  =  Tp  =  O.TTv.  The  curves  in 
this  figure  show  a  roll-off  near  a  velocity  of  iry  =  n/Z.  This 
can  also  be  seen  in  the  spacing  between  the  curves  of  Fig.  13. 

Figure  IS  shows  a  comparison  between  the  actual  maximum 
MTF  curve  of  Fig.  14  and  the  result  of  using  the  velocity  sep¬ 
aration  approximation  given  by  Eq.  (18).  The  numeric  data  for 
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Fig.  13.  Dynamic  lina-array  MTF,  T,  =  Fg. 
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Fig.  14.  Dynamic  lina-array  MTF.  T„  =  Tg  =  O.TT/g. 

Fig.  15,  along  with  percent  error  information,  are  presented  in 
Table  1.  The  error  values  supjxjrt  the  conclusion  reached  earlier 
that  velocity  effects  are  not  separable  from  the  overall  dynamic 
MTF  expression. 

Figure  1 6  shows  the  mean  MTF  of  an  FT  CCD  as  a  function 
of  0p  for  several  input  frequencies,  with  no  image  velocity  and 
—  TPy.  A  graph  of  MTFy  for  the  conditions  of  Fig.  16 
would  be  identical  to  that  shown  but  would  be  flipped  horizon¬ 
tally  to  have  the  maxima  at  0;,  =  90°.  Figure  17  shows  the 
effects  of  image  velocity  on  the  MTF,  for  an  area-array  CCD. 

Figures  18  and  19  show  typical  CTF  curves  as  a  function  of 
(!;«.  The  shape  of  the  curves  is  quite  different  from  the  corre¬ 
sponding  MTF  graphs  in  Figs.  9  and  10.  Figures  20  and  21 


MTT 


VI 

Fig.  15.  MTF  velocity  saperation. 
TABLE  I.  MTF  veiocity  separation  data. _ 


V-! /H 

Actual  MTF 

Approximated 

MTF 

Percent 

Error 

0 

0.7764 

0.7764 

0.00 

0.05 

0.7755 

0.7756 

0.02 

0.10 

0.7727 

0.7732 

0.07 

0.15 

0.7682 

0.7693 

0.14 

0.20 

0.7618 

0.7637 

0.25 

0.25 

0.7537 

0.7566 

0.39 

0.30 

0.7439 

0.7480 

0.56 

0.35 

0.7324 

0.7379 

0.75 

0.40 

0.7193 

0.-’263 

0.97 

0 . 45 

0.7049 

0.7134 

1.21 

0.50 

0.6889 

0.6990 

1.47 

0.55 

0.6716 

0.6834 

1.75 

0.60 

0.6532 

0.6665 

2.03 

0.65 

0.6336 

0.6484 

2.34 

0.70 

0.6129 

0.6292 

2.65 

0.75 

0.5913 

0.6089 

2.97 

0.80 

0.5689 

0.5876 

3.29 

0.85 

0.5458 

0.5654 

3.61 

0.90 

0.5220 

0.5424 

3.92 

0.95 

0.4976 

0.5187 

4.24 

1.00 

0.4728 

0.4943 

4.55 

show  the  static  CTF  as  a  function  of  spatial  frequency  for  r„  - 
Tp  and  TTa  =  Tp.  respectively.  Notice  that  the  CTF  is  always 
1  for  frequencies  below  half  the  Nyquist  frequency.  Notice  also 
that  the  maximum  CTF  is  1  for  all  frequencies  out  to  the  Nyquist 
limit. 

Figure  22  displays  the  mean  CTF  as  a  function  of  frequency 
for  several  velocities,  with  Ta  =  Tp.  Notice  that  a  moving  image 
causes  the  CTF  to  degrade  below  a  value  of  1  at  frequencies 
lower  than  half  the  Nyquist  frequency,  which  does  not  occur  on 
the  static  graphs.  Figs.  20  and  21.  Figure  23  shows  the  CTF  as 
a  function  of  velocity  for  Ta  =  Tp  =0.5Tv.  This  graph  suggests 
that  velocity  separation  is  not  possible  for  the  CTF  calculations, 
because  the  three  curves  have  dissimilar  shapes. 
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Fig.  17.  Dynamic  area-array  MTFy  vs  Vpy. 


Figures  9  through  12  demonstrate  conclusively  that  appli¬ 
cation  of  the  MTF  to  discrete  devices  gives  a  multivalued  result 
over  a  wide  range.  This  wide  variation  in  the  calculated  MTF 
depends  only  on  the  alignment  between  the  image  and  the  device 
pixels.  Similar  results  for  the  CTF  are  shown  in  Figs.  18  through 
- 1 .  Any  experimental  procedure  for  measuring  the  performance 
of  CCDs  or  other  discrete  devices  must  recognize  these  varia¬ 
tions.  The  MTF  and  CTF  curves  shown  in  Figs.  11,  12,  20,  and 
21  are  the  most  important  results  for  system  designers,  since 
they  indicate  the  extremes  and  the  expected  value  of  the  CCD 


Fig.  19.  Variation  in  CTF  dua  to  offset  iIim  for  the  dynamic  lino-array 
case. 

response.  Systems  incorporating  CCDs  can  better  meet  speci¬ 
fications  when  designers  have  this  more  complete  information 
about  device  response. 

The  dynamic  MTF  graphs.  Figs.  13  through  15,  and  dynamic 
CTF  graphs.  Figs.  22  and  23.  display  the  effect  of  velocity  on 
CCD  performance.  In  all  cases,  the  MTF  is  reduced  signihcantly 
for  all  spatial  frequencies.  Figure  15  and  Table  I  show  conclu¬ 
sively  that  the  velocity  effect  is  not  in  general  separable  from 
the  overall  MTF  calculation.  At  low  velocities,  however,  the 
errors  introduced  by  using  the  separation  approximation  of  Eq.  18 
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Fig.  20.  Static  line-array  CTF,  T,  =  T^. 
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Rg.  21.  Static  line-array  CTF,  2ra  =  Tg. 

are  low.  In  addition,  the  other  case  for  separability  mentioned 
in  the  theoretical  development  also  holds,  with  no  errors  intro¬ 
duced.  No  attempt  was  made  to  develop  velocity  separation  for 
the  CTF  because  of  the  complicated  algorithms  involved. 

The  area-array  MTF  graphs.  Figs.  16  and  17,  display  the 
effects  of  oblique  images  on  CCD  performance.  The  important 
conclusions  to  be  drawn  from  these  graphs  is  that  the  line-array 
calculations  apply  only  along  the  two  axes  of  an  area-array  device 
and  that  oblique  images  significantly  change  the  MTF  as  cal¬ 
culated  along  either  axis.  Since  the  orientation  of  images  is 
generally  unknown  for  practical  imaging  systems,  designers  should 
not  consider  one-dimensional  calculations  as  the  typical  rcspxmse 
of  a  CCD. 


CTF 


P 

Rg.  22.  Dynamic  lina-array  CTF.  =  T^. 


CTT 


vy 

Rg.  23.  Dynamic  lina-array  CTF,  To  =  Tg  =  O.STm. 

4.  CTF  MEASUREMENTS 

This  section  describes  the  CCD  system  used  for  experimental 
tests  and  the  test  apparatus.  It  also  describes  the  test  methods 
and  discusses  the  data  obtained  from  the  expreriments. 

The  Texas  Instruments  TCK103  Evaluation  Kit  was  chosen 
for  experimental  analysis.  This  kit  contains  the  TCI 03  CCD  and 
supprart  circuitry  on  one  circuit  board,  requiring  only  pmwer 
supplies  for  operation.  The  TCI 03  CCD  chip  is  a  2048  pixel 
line-array  device  with  pixel  width  and  pixel  pitch  of  12.7  ptm. 
giving  an  active  region  approximately  26  mm  in  length. 

The  TCK103  kit  was  chosen  for  evaluation  primarily  because 
it  requires  no  external  circuitry.  An  opnional  external  circuit  was 
attached  to  control  the  scan  interval.  This  external  control  opT- 
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TABLE  II.  ExDorimontai  CTF  moasursmanta. 

rocaX*L«n9tn  Grating 

Light 

Lans 

Sourca 

Input  Pattern 

Maximum 

Minimum 

Mean 

Frequency 

CTF 

CTF 

CTF 

/ 

1 - 0 — I 

-c 

Ip/mm 

2 

1.0 

1.0 

1.0 

_ 25  ^  _  25  C»  _ 

4 

1.0 

0.944 

0.978 

1  1 

10 

1.0 

0.922 

0.977 

20 

0.75 

0.5 

0.616 

Rg.  24.  Diagram  of  axparimantal  apparatus. 

40 

0.45 

0.0 

0.233 

Rg.  25.  Photograph  of  2  fp/nim  output. 


Rg.  26.  Photograph  of  4  fp/mm  output. 


Rg.  28.  Photograph  of  20  fp/mm  output. 


Rg.  29.  Photograph  of  40  €p/nim  output. 


crated  the  CCD  on  one  clock  to  stabilize  the  output  display  on 
an  oscilloscope.  Operating  conditions  for  the  CCD  were  chosen 
for  stable  operation  of  the  CCD  and  minimal  distortion  in  the 
internal  waveforms.  The  kit  proved  to  be  very  stable,  with  no 
noticeable  drift  in  operating  parameters  after  several  hours  of 
continuous  operation. 

Figure  24  shows  the  experimental  apparatus,  which  projects 
a  square-wave  image  from  a  Newport  MGP-series  moire  grating 
onto  the  CCD.  CTF  measurements  can  be  made  directly  from 
an  oscilloscope.  Five  gratings  were  used,  with  spatial  frequen¬ 
cies  of  2,  4,  10.  20.  and  40  line  pairs  per  millimeter  (fp/mm). 
The  40  fp/mm  image,  while  just  beyond  the  Nyquist  limit  of 
the  CCD.  was  used  to  establish  a  limit  on  the  CCD  behavior  for 
high  input  frequencies. 

The  apparatus  was  designed  to  obtain  a  clean  square  wave 
pattern  with  a  zero  minimum  and  low  diffraction.  This  was 
obtained  for  the  low-frequency  inputs.  However,  diffraction  and 
aberrations  could  not  be  completely  eliminated  and  were  very 
noticeable  for  the  20  and  40  fp/mm  gratings.  For  these  gratings, 
it  was  not  possible  to  obtain  a  zero  minimum  input  to  the  CCD. 

Figures  25  through  29  are  oscilloscope  photographs  of  the 
typical  output  waveforms  for  the  five  inputs.  Each  short  hori¬ 
zontal  line  segment  is  the  output  from  one  pixel.  The  experi¬ 
mental  CTF  is  calculated  by  using  the  measured  values  of  ad¬ 
jacent  maxima  and  minima.  Results  from  these  calculations  are 
shown  in  Table  II  and  are  plotted  in  Fig.  30.  The  data  points 
for  20  and  40  fp/mm  have  a  high  uncertainty,  owing  to  the 
conditions  described  earlier. 

Figure  30  shows  die  theoretical  and  experimental  data.  The 
three  theoretical  curves,  maximum,  mean,  and  minimum,  do 
not  have  labeled  data  points.  Experimental  measurements  were 
not  taken  at  enough  frequencies  to  make  conclusive  remarks 
about  the  overall  graph.  However,  the  variations  in  the  CTF  at 
each  frequency  are  notable.  Although  it  is  not  feasible  to  compare 
directly  the  measured  and  calculated  values  because  of  diffrac¬ 
tion  and  other  experimental  problems,  the  most  significant  fea¬ 
ture  of  the  theoretical  woric  can  be  observed:  the  multivalued 
nature  of  the  MTF  and  CTF  when  used  to  describe  discrete 
devices. 

The  multivalued  nature  shows  on  the  oscilloscope  photo¬ 
graphs  as  a  beat  frequency  phenomenon.  As  «!>//  changes  from 
one  line  pair  to  the  next,  the  CTF  increases  and  decreases.  The 
derivations  in  Sec.  2  predict  this  variation,  as  shown  in  Figs. 
18  and  19. 

5.  DISCUSSION 

The  theoretical  work  presented  in  Sec.  3  provides  a  detailed 
examination  of  the  behavior  of  ideal  CCD  pixels,  as  measured 
by  the  MTF  and  CTF.  This  information  is  useful  not  only  to  the 
d^igners  of  systems  incorporating  discrete  devices  such  as  CCDs 
but  also  to  the  designers  of  test  equipment. 
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Fig.  30.  Comparison  between  experimental  and  theoretical  CTF. 

Figures  11.  12,  18.  and  19  are  the  most  significant  results  of 
the  theoretical  work.  They  provide  the  ideal  MTF  and  CTF  for 
the  frame  transfer  and  interline  transfer  CCDs.  The  behavior  of 
CCDs  in  real  systems  should  be  close  to  that  shown  in  the  figures. 
Designers  of  CCD-based  optical  systems  should  specify  CCD 
requirements  by  the  maximum,  mean,  and  minimum  spatial  fre¬ 
quency  response  to  achieve  desired  system  performance. 

Figure  16  is  also  significant  since  it  displays  the  effects  of 
oblique  images  on  area-array  CCDs.  This  result  is  important 
because  most  applications  are  not  limited  to  images  that  are 
aligned  with  the  CCD  axes.  In  general,  an  image  can  occur  at 
any  orientation,  and  the  angle  between  the  image  and  the  CCD 
axes  will  affect  the  MTF  and  CTF. 

The  experimental  data  presented  in  Sec.  4  support  the  the¬ 
oretical  work  by  demonstrating  that  the  CTF  varies  over  a  sig¬ 
nificant  range.  Although  the  results  shown  in  Fig.  30  are  not  as 
close  to  theory  as  desired,  the  experimental  data  and  the  theo¬ 
retical  curve  do  exhibit  similar  features,  most  noticeably  the 
knee  near  the  frequency  of  20  €p/mm. 

The  variations  in  the  MTF  and  CTF  at  a  given  spatial  fre¬ 
quency  can  be  very  large  and  will  have  a  significant  effect  on 
system  performance.  The  measured  variations  presented  in  Sec. 
4  show  the  effects  of  sampling.  A  multivalued  MTF  or  CTF  is 
an  unavoidable  result  of  applying  a  linear  space-  and  fime-invariant 
characterization  technique  to  a  discrete  device. 

All  discrete  devices,  whether  used  for  imaging  or  display, 
will  exhibit  the  MTF  and  CTF  characteristics  developed  herein. 
Significantly,  the  combination  of  discrete  imaging  and  display 
devices  in  one  system  can  result  in  much  wider  variations  in  the 
MTF  and  CTF  than  one  such  device  alone.  When  presented  to 
a  human  user,  the  display  may  fluctuate  severely,  in  both  time 
and  space,  even  with  a  static  source  image.  Assuming  best-case 
response  for  all  discrete  components  will  probably  result  in  an 
unusable  system. 

6,  CONCLUSION 

This  work  has  presented  a  detailed  mathematical  examination 
of  the  modulation  transfer  function  and  contrast  transfer  function 
as  applied  to  discrete  devices,  particularly  charge-coupled  de¬ 


vices.  The  theoretical  MTF  and  CTF  have  been  calculaied  fi 
a  number  of  widely  used  CCD  configurations.  This  work  ha 
also  analyzed  the  expenmental  CTF  response  of  a  CCD.  Becaus 
CCDs  are  time  and  space  vanant  and  the  MTF  and  CTF  assum 
time  and  space  invariance,  no  unique  CCD  response  can  b 
determined. 

A  number  of  extensions  to  this  work  are  possible.  Nonidea 
pixels,  nonuniform  pixels,  and  noise  conditions  were  not  con 
sidered  in  the  model  and  could  be  included  in  an  expandei 
theoretical  effort.  In  addition,  the  CTF  theory  can  be  expandei 
to  the  same  level  as  the  MTF  theory  by  accounting  for  obliqut 
images  on  an  area-array  CCD.  The  expenments  can  be  greath 
improved  on  by  using  better  apparatus,  recording  more  data  a 
more  frequencies,  incorporating  dynamic  images,  analyzint 
area-array  CCDs,  and  attempting  to  measure  the  MTF  as  wel 
as  the  CTF. 

The  multivalued  nature  of  the  MTF  and  CTF  also  points  ou' 
a  possible  extension:  the  definition  of  one  or  more  new  char 
acterization  methods.  Such  new  methods  may  include  feature: 
of  the  MTF  and  CTF  or  be  based  on  different  characterizattor 
images.  New  methods  that  could  analyze  both  continuous  anc 
discrete  devices  without  the  multivalued  problem  posed  by  the 
MTF  and  CTF  would  be  very  useful  for  design  of  optical  ana 
electro-optical  devices  and  systems. 
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1.  INTRODUCTION 

The  infrared  communit;  aitac  i  universally  accepts  as  axiomatic 
that  the  minimum  resolvahic  temperature  difference  (MRTD)  is 
the  parameter  that  is  indicative  of  the  performance  of  thermal 
imaging  systems,  which  may  consist  of  individual  components 
such  as  an  IR  detector,  a  cooling  system,  an  IR-to-visual  con¬ 
vener.  and  a  display.  The  present  form  of  the  MRTD  equa¬ 
tion,'"^  though  limited  in  scope,  has  been  used  successfully  for 
many  years.  This  MRTD  model,  commonly  referred  to  as  the 
Ratches  model,  is  valid  only  for  particular  IR  imaging  systems. 
Since  the  publication  of  the  Ratches  model  in  1975.  however, 
much  progress  has  been  made  both  in  the  measurement  and 
design  of  IR  imaging  systems.  Accordingly,  the  Ratches  model 
now  needs  to  be  improved  or  modified  to  adapt  to  the  changing 
IR  devices  and  IR  imaging  concepts. 

A  recent  work  has  already  pointed  out  several  important  as¬ 
pects  that  have  to  be  incorporated  to  suit  the  needs  of  newer  IR 
systems.'*  However,  just  as  the  Ratches  model  is  for  a  special 
IR  imaging  system,  namely,  the  series  scan  system  along  hor¬ 
izontal  direction,  all  of  the  improved  MRTD  models^'^  are  also 
for  special  systems  or  devices.  None  of  these  MRTD  formula- 
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tions  is  general  enough  and.  therefore,  cannot  be  adapted  to  an 
arbitrarily  new  IR  system.  For  example,  there  exists  no  reliable 
MRTD  formulation  that  can  be  used  for  the  testing  of  stanng 
IR  systems.^  Staring  IR  systems  are  the  m^st  recent  addition  to 
the  already  existing  IR  systems  and  are  expected  to  perform 
better  than  the  scanning  systems  in  terms  of  temporal  frequency 
response,  spatial  frequency  response,  quality  of  imaging,  and 
sensitivity. 

In  this  work,  we  formulate  a  universal  MRTD  equation  that 
is  then  used,  as  an  example,  in  the  derivation  of  the  MRTD 
suitable  for  the  staring  IR  systems. 

2.  MRTD  CONCEPT 

The  MRTD  is  defined  with  a  standard  experiment.*  shown  in 
Fig.  1.  The  test  system  can  be  considered  as  a  nonfeedback 
linear  system.  The  test  configuration  consists  of  a  target  (in¬ 
volving  a  blackbody  source,  an  ambient  plate,  a  standard  test 
pattern,  and  collimating  optics),  the  to-be-tested  IR  equipment, 
and  the  eye-brain  system.  In  general,  the  test  pattern  shown  in 
Fig.  2  is  standard. 

In  the  MRTD  test,  the  test  pattern  is  placed  at  the  focal  plane. 
Initially,  the  temperature  difference  AT  between  the  test  pattern 
and  the  ambient  plane  is  set  equal  to  zero.  The  AT  is  then  adjusted 
until  three  out  of  four  observers  agree  that  the  pattern  is  dis¬ 
cernible  as  a  four-bar  pattern.  This  AT  is  the  MRTD  value  for 
the  system  under  consideration  at  that  spatial  frequency.  The 
procedure  is  then  repeated  with  different  test  panems.  each  hav¬ 
ing  a  different  spatial  frequency.  Finally,  the  MRTD  curve  is 
obtained  by  plotting  AT  as  a  function  of  spatial  frequency. 

3.  GENERALIZED  MRTD  FORMULATION 

The  MRTD  model  is  based  on  two  essential  hypotheses.  As  in 
the  Ratches  model,  it  is  assumed  that  the  only  fact  that  can  affect 
the  recognition  of  a  scene  is  the  signal-to-noise  ratio  of  the  scene. 
When  the  SNR  exceeds  a  particular  threshold  value  SNR,h,  the 
test  pattern  becomes  recognizable.  Another  hypothesis  under¬ 
lying  the  current  work  is  the  concept  of  “matched  filter.”  The 
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tarqtt  i 

t«st«d  cquipaant 

•ya-brain 

Hlr 

Fig.  1.  Standard  test  system  for  measuring  IMRTD. 


By  delinioon.  the  signal  is  the  peak-to-peak  value  of  the  image 
Thus,  conesponding  to  Fig.  2,  the  signal  on  the  display  screen 
Sd,  can  be  determined  from  the  difference  of  ejiO.O)  and  e,j{a,0) 
Note  also  that  the  input  signal  is  AT.  a  difference  value.  Thus 
by  arbitrarily  sening  ed(a.O)  as  zero,  is  given  by 


Fig.  2.  Standard  MRTD  target  pattern. 

eye-brain  system  is  considered  as  a  matched  filter.  This  filter  is 
not  real,  signal  and  noise  are  not  really  filtered  through  it.  The 
filter  functions  by  maximizing  the  SNR  only.  Its  characteristics 
depend  on  the  spectral  distributions  of  both  signal  and  noise. 
Generally  speaking,  this  matched  filter  consists  of  two  parts:  eye 
and  brain. 

In  this  paper,  we  use  H„/,  He,  and  Ht  to  represent  the  transfer 
functions  of  the  matched  filter,  eye.  and  brain,  respectively.  In 
the  Laplace  domain,'^  also  referred  to  as  the  s-domain. 


Jd  =  ed(O.O)  =  AT  jj  HH.df.df,  (5 

—  IX 

Finally,  the  perceived  signal  may  be  obtained  as 

*•  ac 

sp  =  AT  ff  HH.,H„,fdf.df,  .  (6, 

—  X 

This  signal  will  be  used  for  formulating  the  SNR. 

Noise  is  contributed  dominantly  by  the  fluctuation  of  the 
incoming  photon  flux  striking  the  IR  equipment  to  be  tested.^ 
Other  subsystems  in  the  test  system,  of  course,  contribute  some 
noise.  However,  for  simplicity,  we  assume  that  there  is  no  built- 
in  noise  source  in  the  IR  device  to  be  tested.  Let  the  noise  power 
spectral  density'”  (caused  by  the  fluctuation  of  photon  flux) 
incident  at  the  to-be-tested  device  be  lV(/,,/v).  According  to  the 
theory  of  random  process. “  the  output  noise  power  spectral 
density  of  a  linear  system  is  equal  to  WH",  where  H  is  the  transfer 
function  of  the  system.  The  perceived  noise  power  spectral  den¬ 
sity  is  thus  given  by  W(fj,J,)H}Afx,fv)Hit{fx.fy)- 

An  extremely  important  relationship  between  the  noise  power 
spectral  density  and  the  vanance  a  (at  a  point)  of  a  random 
process  is  given  by 


H„,is)  =  Heismis)  .  (I) 

Note  that  the  signal  is  defined  in  terms  of  its  peak-to-peak  value 
and  the  noise  is  measured  by  its  rms  value.  The  basic  MRTD 
equation  now  can  be  formulated  as  follows.  The  two-dimen¬ 
sional  image  distribution  on  the  display  screen  is  given  by 

ej(x.y)  =  ATid(x.y)  ,  (2) 

where  AT  is  the  temperature  difference  between  the  bars  and 
background  and  iAx.y)  is  the  normalized  image  distribution 
incident  on  the  display  screen. 

Considering  the  relationship  between  the  normalized  image 
distribution  id(x,y)  on  the  display  screen  and  the  normalized 
target  distribution  i,{x,y)  on  the  object  plane.  id{x,y)  is  obtained 


id(x.y) 


-  //  /.</„ 


/»)//, r(/x,/v)exp(y2ir(/^  +  fyy)]df,,dfy 


where  HA  fx,fy)  is  the  transfer  function  of  the  to-be-tested  equip¬ 
ment  and  lA  fx,fy)  is  the  Fourier  transform  of  the  normalized 
target  distribution.  In  other  words.  Ii(fx,fy)  is  Just  HAfx,fy),  the 
transfer  function  of  the  target.  Combining  Eqs.  (2)  and  (3),  the 
image  distribution  on  the  display  screen  can  be  expressed  as 


edix.y)  =  AT 


f  f  H,ifx 


.fy)H,r(fx.fy)exp[j2-n(f,x  +  fyy)]dfydfy 


=  JJ  W(A,fy)dfxdfy 


If  we  consider  a  as  the  corresponding  rms  noise  value.'  then 
the  total  perceived  rms  noise  value  of  the  test  system  becomes 


**  ,1/2 
=  Jj  WHlHifdf^dfy 

—  X 

Now  we  may  obtain  the  SNR  as 

>  X 

AT  jj  HH.rH„ydfydfy 
SNR  =  ^  =  ^ 

r  f  r  1 

jj  WHfrHiddfAA 


Equation  (9)  has  a  straightforward  implication.  The  SNR  as¬ 
sociated  with  any  generic  IR  system  is  evaluated  by  specifying 
only  AT  and  W  as  inputs.  By  setting  a  specific  SNR  as  the 
threshold  value  for  a  human,  the  relevant  expression  of  MRTD 
is  found  to  be 


MRTD  = 


SNR,h  j j  WHfAii/dfxdf, 

—  X 
X 

j  j  HH.rH„fdf.df, 
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here  SNRm  is  the  threshold  value  of  the  SNR  for  the  human 
^  The  universal  MRTD  expression  as  given  by  Eq.  (10)  has 
^en  derived  from  the  three  most  basic  system  blocks  shown  in 
pjjj  1  For  understanding  and  use  of  the  tormula,  the  five  pa- 
ranieiers  of  the  equation  are  elaborated  next. 

Hi  is  the  transfer  function  of  the  four-bar  standard  test  target, 
v^hich  in  turn  is  a  function  of  spatial  frequency  This  is  why 
vIRTD  is  the  function  of  spatial  frequency  of  the  test  target. 
Ihere  have  been  many  works'  that  provide  many  different 
tornis  for  H,  with  different  approximations.  The  systems  de- 
,mner  who  plans  to  use  the  universal  MRTD  expression  can 
, elect  the  one  that  is  most  suitable  to  his  or  her  design.  H,r  is 
the  transfer  function  of  the  IR  device  to  be  tested,  which  is  just 
what  the  designers  have  to  design.  W  represents  the  input  noise 
that,  in  general,  can  be  a  white  noise.  Finally.  H„f  and  SNR,h 
ire  quantities  that  depend  on  the  human  visual  psychophysics. 
.\1I  of  the  terms  of  the  MRTD  expression  are  nothing  but  system 
parameters  that  can  be  certainly  calculated  or  estimated. 

For  convenience,  the  test  pattern  h,  can  be  taken  to  be 


tor  which  the  corresponding  transfer  fu.,.'tion  is 

H,\ =  sinclu/,)comb(ti/,)  *•-) 

In  this  expression  of  H,.  two  assumptions  are  made;  the  four- 
bar  pattern  is  assumed  to  be  infinitely  extensive  along  the 
y-direction  and  penodic  and  infinitely  extensive  along  the 
\-direction. 

The  H„i  is  given  by  Eq.  (1).  while  H,  can  be  approximated 
as  expi  -DfjM),  where  D  is  a  light-level-dependent  parameter 
and  M  is  the  system  magnification.*  Again,  Hb  is  given  by 
H,i  f.JyWAf.Jy).  where  He  is  the  normalized  Founer 

transform  of  a  single  bar  selected  by  the  eye  from  the  four-bar 
target  such  that  //,  (0,0)  =  1  In  the  derivation  of  Ht  the  input 
noise  is  assumed  to  be  white.  The  system  designer  may  determine 
Hni,  for  other  types  of  noise,  too. 

Equation  ( 10)  can  be  considered  the  most  basic  formula  of 
MRTD.  Most  of  the  other  MRTD  formulations  are  device  spe¬ 
cific  expressions.  In  practice,  both  the  test  system  and  the  IR 
equipment  to  be  tested  may  have  different  configurations.  For 
example,  an  MRTD  formula  may  involve  the  transfer  function 
of  an  optical  subsystem,  provided  the  designer  could  identify 
and  characterize  an  optical  subsystem  of  the  test  system.  How¬ 
ever,  another  formula  may  not  involve  such  a  term  when  the 
system  designer  is  not  able  to  individually  characterize  the  op¬ 
tical  subsystem.  Thus,  it  often  becomes  confusing  for  the  MRTD 
users  to  apply  the  MRTD  formula  with  certainty.  The  modular 
form  of  Eq.  ( 10)  makes  it  very  easy  for  every  systems  designer 
to  derive  an  MR  I’D  formula  suitable  for  his  or  her  own  system. 
In  the  next  section,  as  an  example,  the  basic  formula  of  Eq.  (10) 
IS  used  to  derive  the  Ratches  MRTD. 


4.  RATCHES  MRTD 
In  the  Ratches  model.' 

fi)Hi(  f y)H, A  f.)  . 


H.r  =  HAfAHAf,)  =  //.!«:.( /x)//d( /../.)  .  ''4) 

H,  =  HAh)HAfA  (151 

where  HA  fA  is  the  transfer  function  of  the  width  of  the  four- 
bar  target.  Hii  /*)  is  the  transfer  function  of  the  length  of  the 
four-bar  tars'*'  //eiecii  fi)  is  the  transfer  function  of  the  electronic 
part  of  the  IR  device  to  be  tested,  and  Hj{ HJy)  is  the  transfer 
function  of  the  display  screen.  Using  Eq.  (6),  the  perceived 
signal  for  the  scanning  IR  device  is  found  to  be 

=  dT  JJ  HiH.rHm/dfAf, 

—  » 

=  1 1  lHA/AHi(/,)nHA/.)HA/,)] 

—  JC 

X  \HAf.)H,{fy)HAfy)WAf, 

=  AT  I  IHA/Ai'HA/M,  f  IHA/JI'IHa /ANA 


The  first  integral  of  Eq.  (16)  involves  pertinent  scanning  char- 
actenstics.  It  can  be  evaluated  (as  shown  in  Sec.  8.1)  to  give 

f  HAfA'HAA)dfi  =  -^.MTF(/o);^  .  (17) 

)  AViV  IT 

-  * 

where  Av,  is  the  distance  between  scan  lines,  v  is  the  scan 
velocity  of  the  display  element,  k  \s  a  constant  for  adjusting 
units,  and  MTF(/o)  is  the  modulation  transfer  function of  the 
to-be-tested  device.  Therefore,  the  perceived  Ratches  signal  be¬ 
comes 


=  -^  MTF(/o)  TL 
Av,v  IT 


(18) 


where  L  accounts  for  the  normalization  of  Hi.  Equation  (8)  can 
be  used  to  determine  the  perceived  Ratches  noise: 


II 


wHfrHiiJfAA 


j j  W(H,^,ec,H^){HiHf  lHAA)f}dAdA 


(19) 


The  noise  spectral  density  W  can  be  found  (as  shown  in  Sec. 
8.2)  to  be 


W(/)  = 


/F=NETD^  W(A) 
vAfi  WifoA  ' 


(20) 


where  NETD  is  the  noise  equivalent  temperature  difference.  Af„ 
is  the  noise  bandwidth  of  the  test  system,  and  fo,  is  the  frequency 
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of  the  test  bar  pattern  along  the  x-direction.  Thus,  the  perceived 
Ratches  noise  becomes 


np 


'f-NETD‘  W(f.) 
vA/;  Wifo,) 


(21) 


Using  Eqs.  (18)  and  (21),  the  SNR  is  thus  obtained  as 


SNR 


^  MTF(/o)  TL 
ay,v  ir~ 


't^NETD^  W(/,) 

Wifo,) 


II 


(22) 


It  must  be  noted  that  the  calculated  SNR  is  valid  for  a  single 
frame  only.  The  MRTD,  however,  should  account  for  all  frames 
during  an  eye  integration  time.  Therefore,  the  MRTD  is  found 
to  be 


MRTD  = 


TT-  SNR,h 
8  MTF(/o) 


AviV 


NETD 


L  f  HfHUfy 

*■  S 

/ /  H^,tPcHlHiHfHldf.dfy 


(23) 


where  Fr  is  the  frame  rate  of  the  IR  system  to  be  tested  and  tg 
is  the  integration  time  of  the  human  eye.  Using  the  following 
definitions  and  relations.' 


qy  =  tj  HfHUfy  s  1  . 

—  X 

4-  ao 

M  HU,lHAfMdfy  . 

JO  "(/oi) 

—  X 

Qy  =  L  f  HfHfAHAmU^  , 


L 


the  scanning  MRTD  reduces  to 

viRTti  =  ^'SNR,h  NETD/o  /  Ay.v  \ 
4(14)"^  MTF(/o)  [FrIe^^qJ 


(24) 

(25) 

(26) 

(27) 

(28) 


which  is  just  the  Ratches  MRTD  formula.  In  the  next  section, 
as  another  example  of  the  use  of  the  generalized  formula,  the 
MRTD  for  a  mosaic  staring  IR  system  is  derived. 


Fig.  3.  Staring  IR  davica. 
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Rg.  4.  MRTD  modal:  (a)  s-domain  and  (b)  Z-domain. 


5.  STARING  MRTD 


The  mosaic  staring  IR  device  (Fig.  3),  as  implied  by  its  name 
is  a  discrete-data  system.  One  of  the  mathematical  tools  devisee 
for  the  analysis  and  design  of  a  discrete-data  system  is  thi 
Z-transform.’  In  our  work,  we  use  Z-transforms  to  establish  thi 
transfer  function  for  the  mosaic  staring  device,  although  a  mon 
powerful  method,  the  state  variable  method,  has  gained  greate 
significance  in  the  studies  of  discrete-data  systems. 

Usually,  the  Z-transform  expression  of  a  system  is  not  ob 
tained  directly  from  the  time  domain  or  spatial  domain  but  fron 
the  Laplace  (s-)  domain.  In  this  case,  the  transform  is  quitt 
straightforward.  Considering  the  system  shown  in  Fig.  4(a),  w> 
notice  that  there  is  only  one  sampling  switch  that  follows  H 
(actually  an  array  of  switches  in  two  dimensions,  as  implied  b; 
the  term  “staring”).  According  to  the  basic  operation  of  trans 
form  from  j-domain  to  Z-domain.’  the  MRTD  expression  fo 
the  mosaic  staring  system  can  be  directly  obtained  from  Eq.  ( 10 
to  give 


SNRrt 


MRTD  = 


II 


\r2 


W{Z,j:,)[H^HMZ,:ZyYH{Z,ZyfdZ,dZ, 


II 


[Hf1'HA(2,2,mzay)dZydZ, 


(29 


where  H{Zx2v)  accounts  for  all  of  the  subsystems  of  the  test 
system  that  follow  the  detector  and  H'  accounts  for  all  subsys¬ 
tems  of  the  to-be-tested  equipment  that  precede  the  detector.  1' 
should  be  noted  that  the  notation  [H'Hd]{Zx.Zy)  does  not  mcar 
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//'(Z,.Zv)Wj(Zt.Z»).’  Figure  4(a)  shows  the  block  diagram  of 
the  system  in  the  5-domain.  According  to  the  transform  rules, 
aJl  blocks  present  in  between  a  pair  of  switches  or  a  switch  and 
the  inpui/output  terminal  are  combined  together  as  a  single  block 
with  argument  s.  The  expression  pertaining  to  the  new  block 
given  by  has  been  transformed  into  the  corresponding 

Z-domain  term,  Figure  4(b)  shows  the  corresponding 

systems  block  diagram  in  the  Z-domain. 

6,  DISCUSSION 

We  have  developed  a  device  nonspecific  MRTD  formula  that  is 
significantly  different  from  the  traditional  MRTD  formulations. 
Most  of  its  modular  terms  refer  to  subsystem  transfer  functions. 
Furthermore,  unlike  the  traditional  MRTD,  the  generalized  MRTD 
formulation  is  not  tied  with  the  NETD. 

Equation  ( 10)  may  appear  to  be  inconvenient  for  the  designers 
of  IR  imaging  systems  because  of  the  lack  of  detailed  systems 
parameters.  However,  because  of  this,  it  has  more  flexibility  to 
adapt  to  all  kinds  of  IR  imaging  systems.  We  showed  that  the 
device  nonspecific  formulation  can  be  used  to  derive  the  Ratches 
MRTD  for  the  scamiing  IR  system.  For  illustration,  we  have 
also  used  the  generalized  MRTD  formulation  for  deriving  the 
MRTD  of  a  staring  IR  system. 


where  the  rect  function  under  consideration  is  taken  to  have  a 
width  l/2/o  and  an  amplitude  of  Tfo  such  that  //If,)  =  1  when 
fi  =  0.  Considenng  the  fact  that  we  are  interested  only  in  the 
peak  value  of  Eq.  (33)  (since  the  minimum  value  was  assumed 
to  be  zero),  Eq.  (30)  reduces  to 

l'2/O 

•  >)«,u)  *  fi„(a))  =  MTF(/o)-  sim2Tr/oJ:)(2/u)<ii 

IT  J 
0 

=  MTF(/o)  -  -  =  MTF(/o)  .  (34) 

ir  IT  IT' 

To  have  identical  units  for  both  Eq.  (34)  and  the  perceived  noise, 
it  is  necessary  to  multiply  the  result  with  a  coefficient  k  such 
that  kAT  yiel^  the  power  emitted  by  a  display  element.  Again, 
for  the  purpose  of  normalization  with  the  area  of  the  display 
screen,  Eq.  (34)  is  divided  by  Ay,v,  where  Ay,  is  the  distance 
between  scan  lines  and  v  is  the  scan  velocity  of  the  display 
element.  Consequently,  Eq.  (34)  gives 

lHJf,)]^H.AA)dx  =  -^  A  MTF(/o)  .  (35) 

Ay.v  IT 
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8.  APPENDIXES 

8,1.  Derivation  of  Eq.  (17) 

The  first  integral  of  Eq.  (16)  can  be  also  evaluated  in  the  spatial 
domain  as 


8.2.  Derivation  of  Eq.  (20) 

W{  f)  can  be  expressed  as 


W(f)  = 


^  W(f) 

W(/o)  ■ 


(36) 


where  C  =  W(  fo).  Note  that  the  NETD  equals  the  temperature 
difference  corresponding  to  the  condition  SNR  =  1 .  Therefore, 
if  the  signal  is  simply  AT,  the  NETD  equals  AT  such  that  AT,  a 
=  1 ,  where  o  is  the  ims  noise.  Thus.  NETD  equals  o.  However, 


[Wh(/, )!'//, r(/J  ■< — >•  hM)  *  hjx)  •  h„{x)  .  (30) 

where  the  asterisk  represents  the  convolution  operation.  For  the 
standard  test  pattern  shown  in  Fig.  2,  hw(x)  corresponds  to  a 
square  wave  that  can  be  approximated  by  its  first  harmonic, 
which  is  4/it  times  the  amplitude  of  the  square  wave,  as 


<30 


W(fo) 


df  = 


c 


WiP) 


df 


(37) 


and  the  noise  bandwidth  of  the  test  system  is  given  by 


4 

hAx)  =  —  (0.5)sin(2u/ox)  +  0.5  ,  (31) 

TT 

where  fo  is  the  horizontal  spatial  frequency  of  the  standard  target 
pattern.  The  bias  value  of  (0.5)  guarantees  that  hw{x)  is  non¬ 
negative.  Since 

4 

hjx]  *  h,r(x)  =  MTF( fo)  —  (0.5)sin(2-ir/oJt)  +  C  ,  (32) 


Afn  = 


1 


W(f) 

mfo) 


df 


By  comparing  Eqs.  (37)  and  (38),  we  find 
^  ~  AP~  Afn 


(38) 


(39) 


where  MTF(  fo)  is  the  modulation  transfer  function'”  of  the  de¬ 
tector  to  be  tested  and  C  is  a  constant,  Eq.  (30)  can  be  evaluated 

a.s 


^.(5)  •  hjx)  *  HM) 


~  hjxt  *  MTF( fo)  —  (0.5)sin(2iT/oJ:)  +  C 

IT 


*  ♦  i/yo 


/  [ 


'  -  i'2ro 


MTF  ( fo)  —  (0.5)sin(2iT/oJ:)(2/o)  +  C  hit  . 

TT 


(33) 


Equation  (36)  can  now  be  expressed  as 


W(f)  = 


NETD^  W(f) 
A/*  W(/o) 


(40) 


As  in  the  first  appendix,  equivalent  radiant  energy  can  be  de¬ 
termined  by  replacing  NETD  with  NETD()k/v).  Again,  since 
/  =  yfx. 


Wif)  ^  ^  W(f,) 
W(fo)  ''  W(/a.)  • 
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and  therefore  Eq.  (41)  leads  to 


W{f)  = 


it-NETP-  J_  W>r^) 


*‘NETD-  m/J 
vv'(/ux) 


(42) 
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Dynamic  modulation  transfer  function  of  a  display  system 


A.  A.  S.  Awwal,  A.  K.  Cherri,  M.  A.  Karim,  and  D.  L.  Moon 


A  theoretical  model  for  characterizing  the  dv-namic  response  of  a  nonscanning  electrooptic  display  system  is 
developed.  The  model  interrelates  the  spatial  frequency  degradations  of  an  image  display  with  both 
phosphor  characteristics  and  relative  velocity  of  the  displayed  object.  Thereafter,  the  analysis  is  extended  to 
compare  the  performances  of  types  P-20.  P-42,  and  P-1052  phosphor  based  displays. 


I.  Introduction 

The  characteristics  of  an  imaging  system  are  usually 
provided  by  either  a  spatial  response  known  as  the 
point  spread  function*  or  the  magnitude  of  the  spatial 
frequency  response  known  as  the  modulation  transfer 
function  (MTF).-  Both  of  these  measures  are  static 
parameters,^  and  accordingly  neither  is  sufficient  for  a 
complete  understanding  of  the  overall  image  quality. 
The  absence  of  temporal  response  considerations  in 
the  auialysis  of  an  imaging  system,  in  situations  such  as 
driving  and  piloting  tasks,  results  in  drastically  de¬ 
graded  modulation  contrast  particularly  at  higher  spa¬ 
tial  frequencies.'*  This  effect  may  be  particularly  sig¬ 
nificant,  for  example,  when  night  vision  goggles 
(NVGs)  designed  for  use  in  the  static  mode  are  used  by 
the  pilots  of  a  helicopter.  In  such  dynamic  situations, 
targets  as  seen  by  the  NVGs  begin  to  blend  with  back¬ 
grounds.  and  the  user  may  fail  to  discriminate  targets 
from  their  backgrounds. 

The  MTF,  defined  as  the  modulus  of  the  Fourier 
transform  of  the  line  spread  function,^  is  a  1-D  quanti¬ 
ty  which  is  measured  along  only  one  direction.  Gener¬ 
ally,  it  is  2Lssumed  that  the  same  frequency  response  is 
exhibited  in  all  directions.  Accordingly,  the  MTF  re¬ 
fers  to  a  circularly  symmetric  frequency  response.  In 
practice,  however,  the  MTF  is  direction  dependent.-’ 
A  frequency  response  derived  from  a  2-D  point  spread 
function  is  expected  to  provide  a  more  accurate  picture 
of  the  MTF.  Furthermore,  the  discrete  nature  of 
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some  of  the  display  systems  prevents  a  slant  edge  from 
being  displayed  with  the  same  quality  as  a  horizontal 
or  vertical  edge.® 

In  specifying  the  MTF,  its  phase  part  is  generally 
neglected.  But  it  is  often  the  phase  that  differentiates 
a  function  h(x,y)  from  its  reflected  version  h{—x,—y). 
A  display  system  responds  differently  when  the  dis¬ 
played  object  is  in  relative  motion  with  the  sensor  than 
when  there  is  no  relative  motion.  The  conventional 
MTF  thus  fails  to  characterize  the  actual  behavior  of  a 
dynamic  system.  In  this  paper,  we  develop  an  analyti¬ 
cal  tool  so  that  the  dynamic  parameters  can  be  used  to 
specify  the  performance  of  a  nonscanning  electroopti- 
cal  display  system  such  as  those  in  NVGs,  intensifier 
tubes,'  and  cameras.  On  one  hand,  this  model  over¬ 
comes  the  discrepancies  of  the  earlier  system  specifica¬ 
tion,  and,  on  the  other  hand,  proper  quantification  of 
dynamic  response  enables  one  to  restore  the  motion - 
degraded  displays. 

11.  Impulse  Response  of  Imagmg  Systems 

In  electrical  system  analysis,  the  impulse  response  is 
used  for  estimating  the  response  due  to  any  time- 
varying  signal.  Testing  a  system  with  an  impulse  sig¬ 
nal  is  equivalent  to  testing  the  system  with  every  spa¬ 
tial  frequency  at  the  same  time.  In  general,  the 
transform  of  the  system  output  provides  a  transfer 
function  which  is  the  temporal  frequency  response  of 
the  system.  When  the  response  of  a  system  is  instan¬ 
taneous  and  when  a  5-function  input  produces  a  5- 
function  output,  the  system  response  is  said  to  be  a 
constant  for  aU  frequencies.  The  advantage  of  an 
impulse  input  specification  is  that  any  signal  can  be 
expressed  as  a  series  of  impulse  functions  separated  in 
time  so  that  the  overall  output  can  be  found  by  con¬ 
volving  the  sum  of  the  input  signals  with  the  impulse 
response. 

The  modulus  of  the  Fourier  transform  of  the  2-D 
point  spread  function  can  be  used  to  yield  the  2-D 
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Linear 

5(x.y.i)  — ^]  System  i - ^ 


Fig.  1.  Linear  system  showing  3-D  impulse  response. 


MTF.‘  Experimentally,  a  system  can  be  illuminated 
with  a  point  source  of  light  (for  a  certain  amount  of 
time),  and  then  its  response  can  be  measured.**  By 
incorporating  the  sense  of  time  and  space,  one  can 
define  a  3-D  impulse  response^  that  behaves  like  an 
impulse  function  in  both  space  and  time.  According¬ 
ly,  we  define  a  3-D  impulse  response  h{x,y,t)  as  the 
response  to  a  narrow  pinhole  of  light  applied  to  a 
system  for  an  infinitesimally  short  duration  of  time.*® 
Conveniently,  the  input/output  relation  can  be  ex¬ 
pressed  schematically  as  in  Fig.  1. 


fled  whenever  the  function  can  be  expressed  as  a 
product  of  two  individual  functions— one  of  which  is 
spatial  while  the  other  is  temporal. 

Since  our  interest  is  in  nonscanning  display  devices, 
temporal  parameters  due  to  electron  beam  sweep  time 
as  that  in  a  cathode  ray  tube  based  display  need  not  be 
considered.  It  is  well  known  that  phosphors  (used  in 
many  of  the  display  devices)  are  associated  with  expo¬ 
nential  decay  characteristics.**  This  implies  that  the 
luminance  can  be  expressed  as  a  product  of  an  initial 
luminance  value  and  a  time  factor.  In  phosphor  based 
display  devices,  therefore,  the  effect  of  a  3-D  impulse 
input  can  be  expressed  as  an  initial  point  spread  func¬ 
tion  multiplied  by  an  exponential  decay  factor*-: 

k(z,y,t)  =  s{x,y)Mt),  i3) 

where  A(t)  =  exp(— t/r)  is  the  dynamic  part  of  the 
point  impulse  response.  Figure  2  illustrates  the  time 
history  of  a  2-D  point  spread  function.  Provided  the 
decay  is  exponential,  it  can  be  shown  (by  normalizing 
the  function  with  respect  to  space  and  time)  that  the 
spatial  and  temporal  parts  of  the  impulse  response  are 
separable.  *°  In  other  words,  when  the  intensity  can  be 
expressed  as  a  product  of  initial  intensity  lo  multiplied 
by  a  time  function,  the  3-D  impulse  response  is  separa¬ 
ble.  Note,  however,  that  the  temporal  part  is  not 
necessarily  separable  from  the  spatial  part  when  the 
decay  rate  is  constant  and  follows  a  second -order  ki¬ 
netics.*® 

ill.  Output  Spectrum  of  Input  Images 

First,  consider  the  case  when  the  object  is  static,  i.e., 
with  no  relative  motion  between  the  object  and  sensor. 
Using  Eq.  (3),  the  output  spectrum  of  the  static  image, 
where  i{x,y,t)  =  i(x,y),  can  be  expressed  as 


Giu,u)  ~  j  ((x\>0/i(x  -  x\y  —  y',t  -  tldx'dy'dt'  eip(“j2)r(ai  +  vy  +  ft)]dxdydt. 

=  I  Hx'.y'}h(z  -  x',y  —  y,t  —  t')  eipj— ;2ir(ui  +  oy  +  ft)]dxdy<it  dx  dy'dt' 

=  I  i(i'.y)s(i  -  x',y  -  y')Mt  -  t’)  exp(-;2T(ui  cy  +  ft)\dxdydt  dx'dy'dt' 


=  S{u,v)D{f)  j  i(x',y)  expl-;2T(ui'  +  uy  +  ft')ldx’dy'dt' 
=  Hu.v)S(u.v)D[f)  j  exp[—J2rl/t'}jdt' 


=  Ku.v)S(u,v)Dif)i{f),  *4) 


For  a  linear  imaging  system,  the  system  output  is 
given  by  the  convolution  integral 

giz.y.t)  =  /  f  fi(x',y',t')h(x  -  x  ,y  —  y'.t  —  t')dx'dy'dt'.  (1) 

where  i(x,y,t)  is  an  input  to  the  system.  The  transfer 
function  of  the  system  is,  however,  given  by 

H(u.v,f)  -  S exp(-;2ir(ux  uy  -t-  ft)]dxdydt.  (2) 

where  u  and  v  are  the  spatial  frequency  components, 
respectively,  along  the  horizontal  and  vertical  direc¬ 
tions  and  f  is  the  temporal  frequency.  Note  that  calcu¬ 
lation  of  the  overall  tremsfer  function  is  greatly  simpli- 


where  the  integral  sign  /„  denotes  an  integral  of  order 
n,  and I{u,u),  S{u,u),D{f),  and  5(f)  are,  respectively,  the 
input  spatial  spectrum,  2-D  static  transfer  function, 
dynamic  transfer  function,  and  dirac  6-function. 
Therefore,  the  output  spectrum  becomes  nonzero  only 
for  a  dc  temporal  frequency.  In  the  absence  of  motion 
the  output  spectrum  is  characterized  simply  by  the 
static  MTF  S(u,u)  of  the  imaging  system. 

When  the  object  is  in  motion,  the  input  function  is 
given  by 

i{x,y,t)  =  i(x  +  mt.y  +  nt),  (5) 
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Fig,  3.  Overall  transfer  funct.on. 


where  for  simplicity  we  have  assumed  that  the  velocity 
is  a  constant  where  x-  and  y-components  are  m  and  n, 
respectively.  In  case  of  a  nonuniform  velocity,  the 
terms  mt  and  nt  are  replaced  by  the  integrals  of  veloci¬ 
ty  components  with  time.  Furthermore,  we  assume 
that  the  energy  incident  from  the  moving  object  is 
invariant  with  time.  Accordingly,  the  light  emanating 
from  the  object  (which  is  a  function  of  both  space  and 
time)  reduces  to  a  function  of  space  alone. 

Using  Eqs.  (1)  and  (5),  Eq.  (4)  yields 

G(u.u,f)  =  j  i(z',y')h(x  -  x'.y  —  y',t  -  t')dx'dy'dt' 

.6 

X  exp(-72ir(ui  +  uy  +  ft)\dxdydt 

=  I  i(x'.y')s(x  -  x’y  -  y')A(f  -  t') 

.6 

X  exp(— ;2t(ui  +  ry  +  /Djdxdydt  dx'dy'dt' 
=  I{u,u)S(u,L')D(f)Hf  -  urn  -  (.nl 
=>  Hu,u)S(u,i')D(u.i;).  (6) 

The  overall  transfer  function,  as  shown  in  Fig.  3,  is  thus 
given  by 

Hiu.L')  =  S(u,v)D(u,v).  IT) 

where  D{u,v)  is  the  dynamic  component  of  the  total 
MTF  H(u,v),  referred  to  as  the  DMTF.  Equation  (7) 
can  be  used  to  predict  the  effect  of  both  velocity  emd 
the  static  transfer  function  on  the  quality  of  the  dis¬ 
played  image. 

IV.  Case  Studies  of  the  OMTF 

Due  to  the  finite  shutter  opening  time  and  the  rela¬ 
tive  velocity  of  the  object,  for  example,  the  correspond¬ 
ing  camera  image  undergoes  a  displacement  on  the 
film.  The  effect  of  such  an  image  motion  on  the  film 
can  be  modeled  by  the  dynamic  response  of  the  cam¬ 
era.  For  a  camera,  the  total  exposure  at  any  point  of 
the  film  is  obtained  simply  by  integrating  the  instanta¬ 
neous  exposure  over  the  total  exposure  time.*’  Ac¬ 
cordingly, 

■  r 

g(z,y)  =*  I  i(x  -  mc.y  -  nt)dt.  (9) 

.'0 

where  T  is  the  total  duration  of  the  exposure.  By 
taking  the  Fourier  transform  of  the  total  response,  one 
obtains 

Giu.u)  =  i  i(x  —  mt.y  -  nt)dt  exp(— j2ir(ui  +  i’y)|didv 

.'j 

=  Hu.u)  I  exp(— ;2T(umf  +  fnf)|df 
= /(u.u)  sinc((um -I- [••alj.  (10) 


In  the  case  of  a  camera,  therefore,  the  dvmamic  part  of 
the  DMTF  is  characterized  by  a  simple  2-D  smc  func¬ 
tion. 

The  DMTF  can  also  be  calculated  from  the  Fourier 
transform  of  the  dynamic  part  of  the  3-D  impulse 
response.  For  the  image  tube,  for  example,  the  point 
impulse  response  is  given  by  Eq.  (3).  Phosphor  decay 
in  the  image  tube  is  exponential  in  nature,  and  it  may 
even  decay  with  several  time  constants. Consider  a 
phosphor  screen  being  illuminated  with  an  input  for  a 
certain  duration,  and  say  at  t  =  0  the  illumination  is 
withdrawn.  This  scenario  is  analogous  to  applying  a 
negative  step  input.  By  differentiating  the  negative 
step  response,  i.e.,  the  phosphor  decay  curve,  the  im¬ 
pulse  response  of  the  screen  can  be  obtained  as 

AU)  »  -(d/dt)IJ„  exp(-t/r)l  »  i/y'r)  expi-e/r),  dll 

where  r  is  the  associated  time  consttmt.  The  dynamic 
part  of  the  DMTF  is  obtained  as 

D(/)  =»  (1 +;2t/t)-'.  a2) 

By  replacing  the  temporal  frequency  /  with  mu  +  t  n, 
therefore,  the  corresponding  spatial  frequency  equiva¬ 
lent  can  be  obtained.  The  dynamic  part  of  the  DMTF 
can  be  approximated  by  an  exponential  function. 

Comparing  the  DMTFs  of  the  camera  and  image 
tube,  one  notices  that  the  former  has  several  zeros. 
Due  to  motion,  therefore,  some  of  the  frequencies  of 
the  information  will  be  totally  lost.  In  the  case  of  the 
image  tube,  however,  the  dynamic  part  of  the  DMTF 
becomes  zero  only  at  the  highest  frequency.  Since 
most  of  the  information  is  localized  within  a  narrow 
bandwidth,  not  much  information  is  lost  due  to  mo¬ 
tion.  In  both  cases,  however,  the  modulation  loss  in¬ 
creases  with  velocity  and  duration  of  exposure.  Note 
that  for  the  case  of  image  tubes,  the  motion-degraded 
images  are  recoverable  by  means  of  inverse  filters. 

V.  Determination  of  the  OMTF 

Studies*®-^^  have  successfully  shown  that  the  time 
constant  increases  with  increasing  temperature.  Im¬ 
portant  experimental  work‘d  has  already  provided  a 
quantitative  estimate  for  the  phosphor  time  constants 
at  various  states.  From  their  data,  we  see  (with  some 
modification)  that  for  a  type  P-20  phosphor.  90%  of  the 
phosphorescence  has  a  time  constant  value  of  <0.3  s. 
8%  of  the  phosphorescence  has  a  time  constant  value  of 
5.4  s.  and  the  remaining  2%  of  the  phosphorescence  has 
a  time  constant  value  of  50  s.  It  was  also  determined 
that  the  10%  time  constant  of  phosphor  is  0.2  ms  with 
100%  of  the  phosphors  in  the  same  state.  For  our 
study,  therefore,  a  reasonable  approximation  can  be 
made  so  that  90%  of  the  phosphor  is  assumed  to  have  a 
10%  time  constant  of  0.2  ms.  Accordingly,  we  calcu¬ 
late  the  DMTF  of  type  P-20  phosphor  and  compare  its 
performance  with  that  of  two  slower  phosphors  P-42 
(of  a  time  constant  of  10  ms)  and  P-1052  (of  a  time 
constant  of  20  ms).'®  '® 

For  the  type  P-20  phosphor  based  display,  one  can 
vectorially  add  the  three  MTFs  using  the  three  time 
constants  and  then  determine  the  MTF  by  taking  the 


10  January  1991  /  Vol.  30.  No.  2  /  APPLIED  OPTICS 


203 


lines/mm 

Fig.  4.  Dynamic  component  of  the  DMTF  for  a  relative  motion  of 
(a)  100  and  (h)  150  mm/s. 

modulus  of  the  resulting  function.  The  dynamic  com¬ 
ponent  of  the  DMTFs  for  the  three  phosphors  are 
shown  in  Figs.  4(a)  and  (b),  respectively,  for  the  rela¬ 
tive  velocities  of  100  and  150  mm/s.  It  can  be  seen  that 
the  high  frequency  response  corresponding  to  type  P- 
20  phosphor  is  significantly  more  desirable  than  those 
corresponding  to  type  P-42  and  type  P-1052  phos¬ 
phors.  The  DMTF  degradation  is  more  severe  at 
higher  relative  velocities.  Figure  5,  for  example. 


lines/ mm 

Fig.  5.  Dynamic  component  ol  the  DMTF  corresponding  to  tvpe  F 
20  phosphor  based  display  for  different  relative  veiix-ities. 


shows  the  dynamic  component  of  the  DMTFs  for  the 
P-20  phosphor  based  display  for  two  relative  veloci¬ 
ties.  The  attenuation  associated  with  tyqie  P-42  and 
type  1052  phosphors  is  too  high,  so  the  high  frequency 
information  content  of  the  corresponding  image  is  to¬ 
tally  lost.  For  the  sake  of  comparison,  consider  the 
dynamic  component  of  the  DMTF  values  only  at  10 
and  15  lines/mm.  The  bandwidth  of  the  DMTF  and 
10%  cutoff  values  are  tabulated  for  both  P-20  and  P- 
1052  (phosphors  with  extreme  characteristics)  in  Ta¬ 
ble  I.  In  displaying  dynamic  objects,  therefore,  image 
tubes  based  on  either  types  P-42  or  P-1052  phosphor 
will  have  a  poorer  performance. 

VI.  Conclusion 

This  paper  discusses  the  importance  of  introducing 
a  dynamic  specification  for  charactenizing  display  sys¬ 
tems.  We  have  demonstrated  that  DMTF  can  be  used 
to  predict  correctly  the  overall  image  quality.  Experi - 
mentally  obtained  data  were  utilized  to  calculate  and 


Tabla  I.  Oynamte  Componvirts  ol  tho  DMTF*  for  P-ZO  and  P-1052  Ptwapnora 


Velocity 

(cm/ sec) 

P-20 

P-1052 

10  l/rain 

15  l/ran 

10%  cutoff 

10  1/ma  15 

1/nun 

10%  cutoff 

10 

90% 

89% 

>.?0  l/mm 

18% 

12% 

17  1/mni 

50 

86% 

83% 

>20  1/nun 

4% 

2% 

4  l/nun 

100 

79% 

75% 

>20  1/nua 

2% 

<1% 

2  l/nun 

150 

70% 

58% 

>20  l/nun 

1% 

<1% 

1  l/nun 
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compare  dynamic  responses  of  three  different  types  of 
phosphor  coated  display  screen.  The  choice  of  select¬ 
ing  a  particular  phosphor  for  a  display  would  directly 
depend  on  the  relative  velocity  of  the  target  and  sen¬ 
sor.  Other  types  of  motion  degradation  effect,  such  as 
those  due  to  vibration,-®  can  also  be  incorporated  into 
the  DMTF  model.  After  having  identified  the  degra¬ 
dation  function  quantitatively,  it  will  be  possible  to 
generate  schemes  and/or  systems  for  the  restoration  of 
motion-degraded  images.'^-'--  The  DMTF  model 
developed  herein  may  be  extended  to  include  the  deg¬ 
radation  introduced  by  rtuidom  noises  due  to  the  inho¬ 
mogeneity  of  the  phosphor  distribution. 
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Restoration  of  moving  binary  images  degraded 
owing  to  phosphor  persistence 


A.  K.  Cherri,  A.  A.  S.  Awwal,  M.  A.  Karim,  and  D.  L  Moon 


The  degraded  images  of  dynamic  objects  obtained  by  using  a  phosphor-based  electro-optical  display  are 
analyzed  in  terms  of  dynamic  modulation  transfer  function  (DMTF)  and  temporal  characteristics  of  the 
display  system.  The  direct  correspondence  between  the  DMTF  and  image  smear  is  used  in  developing 
real-time  techniques  for  the  restoration  of  degraded  images. 


I.  Introduction 

Imaging  systems,  in  general,  and  displays,  in  particu¬ 
lar,  are  evaluated  in  a  static  mode.  For  many  of  the 
imaging  applications,  the  temporal  characteristics  of 
the  imaging  system  may  not  be  critical.  In  dynamic 
environments,  however,  the  temporal  response  of  an 
imaging  system  plays  a  more  important  role  than  the 
static  response  in  determining  the  quality  of  the 
display.  The  absence  of  tempoi^  response  consider¬ 
ations  in  the  analysis  of  a  traditional  imaging  system, 
in  situations  such  as  driving  and  pilotage  tasks,  fails 
to  explain  the  cause  of  degradation  of  the  modulation 
contrast.  This  degradation  becomes  more  significant 
at  higher  spatial  frequencies.  In  such  situations,  for 
example,  targets  begin  to  blend  with  the  background, 
and  the  user  loses  the  ability  to  discriminate  between 
the  two.  To  characterize  fully  an  electro-optical  imag¬ 
ing  system,  therefore,  requires  that  both  static  and 
d}mamic  aspects  be  considered. 

It  has  already  been  shown  that  phosphor  persis¬ 
tence  affects  the  temporal  response  of  a  cathode-ray- 
tube  display. In  a  dynamic  environment  where 
there  is  a  relative  motion  between  the  target  and  the 
sensor,  longer  persistence  value  reduces  the  modula¬ 
tion  contrast  and  eventually  causes  the  loss  of  gray 
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levels.  Often  the  loss  of  one  gray  level  at  a  high  spatial 
frequency  may  be  significant,  for  example,  where 
there  is  only  enough  modulation  contrast  to  provide 
one  or  two  gray  levels  in  a  static  environment.  In  a 
more  recent  work^  we  established  an  analytical  formu¬ 
lation  of  the  dynamic  modulation  transfer  function 
(DMTF)  for  a  nonscanning  display  system.  In  particu¬ 
lar,  for  a  phosphor-based  display  system  the  DMTF 
has  been  shown  to  be  a  product  of  the  classical 
modulation  transfer  function  and  a  dynamic  function 
dependent  on  phosphor  persistence  and  object  mo¬ 
tion. 

In  this  paper  we  demonstrate  that  the  smearing  of 
a  displayed  image  may  be  properly  quantified  by 
considering  the  temporal  response  in  the  imaging 
system  analysis.  Also,  we  show  that  the  phosphor 
type  as  well  as  the  value  of  the  relative  motion 
between  the  target  and  the  sensor  plays  a  significant 
role  in  image  degradation.  Following  the  identifica¬ 
tion  of  proper  degradation  function,  real-time  tech¬ 
niques  are  proposed  for  the  restoration  of  motion- 
degraded  images.  Note  that  related  work  on  the 
restoration  of  images  degraded  by  linear  smear  such 
as  that  in  photographic  films  has  already  been  done.^ 

II.  Dynamic  Modulation  Transfer  Function  Review 

Figure  1  is  a  block  diagram  of  an  imaging  system 
where  an  input  object  i(x,y,  t)  is  operated  on  by  the 
point-impulse  function^  A(x,  y,  t)  to  produce  an  out¬ 
put  image  g(x,  y,  t).  Provided  that  the  point-impulse 
response  function  h(x,  y,  t)  can  be  expressed  as  a 
product  of  a  pm^ly  spatial  function  s(x,  y)  and  a 
purely  temporal  function  A(f ),  such  as 

Ate,  y,  t)  “  ste,  ),  ( 1 ) 
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^  h(x,y,e) 


S(x,y,t) 


Fig.  1.  Block  diagram  ofaneleccro-opCicalimaguig  system. 


one  may  evaluate^  the  Fourier  transform  of  gix,  y,  t) 
as 


G(u,  u,f)  =  D(  f)S(u,  v)I{u,  u)8(  f  -  urn  -  vn>,  (2) 

where  m  and  n  denote  velocity  components  along  the 
X  and  y  directions,  respectively;  u  and  v  represent  the 
spatial  frequencies  along  the  x  and  y  directions, 
respectively;  f  is  the  temporal  frequency,  and  Z)(  f), 
S(u,  v),  and/(u,  v)  are  the  dymamic  transfer  function, 
the  static  transfer  function,  and  the  spectrum  of  the 
static  image,  respectively.  The  presence  of  the  factor 
U  f  -  um  -  un)  implies  that,  during  the  evaluation  of 
G{u,v,f),  the  variable  fin  D(  f)  needs  to  be  replaced 
with  um  +  vn.  The  overall  system  block  diagram  of 
the  electro-optical  display  that  is  shown  in  Fig.  2 
includes  both  static  and  dynamic  transfer  functions. 
The  p.”  jduct  D(  f)S(u,  v)U  f  ~  um  -  vn)  is  referred 
to  as  the  DMTF.  This  new  form  for  the  spatiotempo- 
ral  transfer  function  of  the  imaging  system  can  be 
used  to  characterize  the  motion-degraded  images.  It 
is  important  to  understand  that  Eq.  (2)  is  correct  as 
long  as  the  separability  condition  of  Eq.  (1)  is  valid. 
Fortunately,  this  separability  condition  remains  valid^ 
as  long  as  phosphor-based  electro-optical  display  sys¬ 
tems  are  considered. 

III.  Decay  Constants  and  Spatial  Speed  Considerations 

A  well-known  phosphor  screen  characteristic  is  pro¬ 
vided  by  its  exponential  decay  behavior,  which  can  be 
approximated  by^ 

Mt)  =  A,  expl-f/T, )  +  A,  expt-^/Tj)  +  A,  exp(-^/T,)  +  . . . ,  (3) 

where  A,  is  a  factor  representing  the  proportion  of  the 
phosphor  in  the  ith  state  and  t,  is  the  corresponding 
time  constant,  defined  as  the  duration  during  which 
the  phosphorescence  decays  to  1/eth  of  its  maximum 
value  A,.  In  general,  the  last  two  terms  of  Eq.  (3) 
represent  fluorescence  modes  of  a  phosphor  light 
output.  When  compared  with  the  first  term,  represent¬ 
ing  the  phosphorescence  mode  of  light  output,  the 
contributions  of  the  last  two  terms  are  insignificant.^ 
Accordingly,  Eq.  (2)  may  be  approximated  by 

Mt)  =  exp(-f/T),  (4) 

where,  for  simplicity.  A,  is  set  equal  to  1/t.  Taking  the 
Fourier  transform  of  Eq.  (4),  we  obtain  the  dynamic 
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Fig.  2.  DMTF  of  an  electro-optical  display. 


Fig.  3.  64  X  64  input  binary  image. 


component  of  the  DMTF  for  the  phosphor  screen  as 

D(f)  =  (l+j2iTfr)-‘.  (5) 

Equation  (5),  representing  the  temporal  transfer 
function  of  a  phosphor  screen,  can  be  introduced  in 
Eq.  (2)  to  preset  the  overall  degradation  of  motion- 
involved  displayed  images.  However,  to  use  D(  f ),  one 
must  estimate  the  specific  value  of  the  time  constant 
of  the  phosphor  used  in  the  electro-optical  display 
under  consideration.  One  may  use  the  fact  that  the 
type  P-1052  phosphor,  for  example,  takes  20  ms  to 
decay  to  10%  of  its  maximum  value.®  Accordingly,  we 
may  set  t  =  8.68  ms  for  the  case  of  type  P-1052 
phosphor. 

To  predict  the  effect  of  the  temporal  response,  in 
accordance  with  Eq.  (5)  one  must  convert  the  tempo- 
rsd  information  into  a  spatial  format.  This  is  done  by 
simply  replacing /"with  um  +  vn.  However,  an  object 
can  move  in  any  one  of  the  following  ways; 

1.  Motion  in  the  x  direction  only  when  f  can  be  set 
equal  to  um. 

2.  Motion  in  the  y  direction  only  when  fcan  be  set 
equal  to  vn. 

3.  Motion  in  the  x-y  plane  making  an  arbitrary 
angle  0  with  the  x  axis,  in  which  case  f  is  set  equal  to 
um  +  vn  ,  provided  that  m  =  v  cos  0  and  n  =  v  sin  0, 
where  v  represents  the  velocity. 

4.  Motion  in  the  z  direction  only,  in  which  case  f 
is  set  equal  to  wp,  where  p  is  speed  in  the  z  direction 
and  w  is  the  corresponding  radial  frequency  compo¬ 
nent. 

5.  Arbitrary  motion  in  x-y-z  space. 

IV.  Simulation  of  Image  Degradation 

To  comprehend  the  extent  of  image  degradation  in  an 
electro-optical  display,  we  consider  a  particular  image 
intensifier  tube,  such  as  that  used  in  night  vision 


10  September  1991  /  Vol.  30.  No.  26  /  APPLIED  OPTICS  3735 


(a) 


(b) 


•>  V  .1  jg«ayt<  - 

Fig.  4.  Images  degraded  as  a  result  of  horizontal  speeds  of  (a)  4 
cm/s,  (b)  8  cm/s,  and  (c)  15  cm/s. 


goggles.  In  this  application  it  is  estimated  that  the 
maximum  angular  movement  of  the  head  (with  the 
goggles)  is  120°/s.'  By  assuming  that  the  distance 
between  the  phosphor  screen  and  the  object  lens  is 
7.62  cm.  for  example,  we  calculate  the  spatial  speed  m 
to  60(1207180°)  7.62  cm  =  15.958  cm/s. 

The  calculated  value  of  m  and  the  experimentally 
determined  value  for  the  time  constant  of  type  P-1052 
phosphor,  for  example,  is  used  in  Eq.  (5)  to  calculate 
the  corresponding  modulation  transfer  function  of 
the  dynamic  response.  A  computer  program  may  be 


used  to  simulate  the  effect  of  the  DMTF  on  unages. 
The  simulation  algorithm  involves  the  followmg  steps; 

1.  Obtain  the  fast  Fourier  transform  (FFT)  of  the 
static  image. 

2.  Obtain  the  FFT  of  A(f )  for  a  particular  motion. 

3.  Multiply  (point  by  point)  the  FFT’s  obtained  in 
steps  1  and  2. 

4.  Take  the  inverse  FFT  of  the  product  to  esti¬ 
mate  degradation. 

A  64  X  64  pixel-sized  binary  image,  as  shown  in  Fig. 
3,  is  used  as  the  input  image  in  the  simulation. 
Figures  4(a),  4(b),  and  4(c)  show  the  corresponding 
degraded  images  when  head  movement  along  the  x 
direction  approaches  speeds  of  4,  8,  and  15  cm/s, 
respectively.  It  is  evident  that  with  increasing  speed 
the  image  degrades  more  and  more.  Since  motion  is 


(b) 

Fig.  5.  Images  degraded  because  of  vertical  speeds  of  (a)  10  cm/s, 
(b)  15  cm/s. 
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(b) 

Fig.  6.  Images  degraded  by  motion  along  (a)  45°  with  10  cm/s,  and 
(b)  20°  with  15  cm/s. 


Holagram 


Fig.  8.  Nonadaptive  restoration  with  a  Founer  hologram  used  as 
an  mverse  filter. 

directed  only  along  the  x  axis,  the  degradation  of 
vertical  edges  becomes  more  significant.  For  compari¬ 
son,  Figs.  5(a)  and  5(b)  show  motion-degraded  images 
for  an  object  moving  in  the  y  axis  at  spatial  speeds  of 
10  and  15  cmys,  respectively;  note  that  in  these  cases 
the  horizontal  edges  are  the  most  effected.  Finally, 
Figs.  6(a)  and  6(b)  show  motion-degraded  images  for 
the  case  of  a  motion  directed  at  angles  of  45°  and  20° 
to  the  X  axis  at  speeds  of  10  and  15  cm/s,  respectively. 
In  Figs.  6(a)  and  6(b),  however,  one  finds  that  both 
horizontal  and  vertical  edges  have  been  degraded. 

V.  Simulation  of  image  Restoration 

In  Section  IV  we  showed  that  the  DMTF  can  degrade 
input  images  (in  the  absence  of  noise,  for  simplicity) 


(a) 


b 

Fig.  7.  Adaptive  restoration:  (a)  modelj  (b)  system. 


Fig.  9.  Image  of  Fig.  4(c)  restored  by  using  inverse  filters  corre¬ 
sponding  to  (a)  12  cm/s,  (b)  7  cm/s. 
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Fig.  10.  Image  degraded  by  a  horuontai  speed  of  5  cm/s  restored 
by  using  an  inverse  filter  corresponding  to  a  horuontai  speed  of  10 
cm/s. 


to  a  degree  that  the  object  is  hardly  recognizable.  To 
restore  the  degraded  images  consider  the  degradation 
model  shown  in  Fig.  2.  In  this  model,  the  object  image 
i(x,  y,  t)  is  operated  on  by  a  degradation  function 
H(u,  V,  f ),  which  produces  a  degraded  output  image g 
(x,  y,  t).  Our  main  objective  is  to  obtain  an  approxima¬ 
tion  of  i(x,  y,  t)  given  gu,  y,  t)  and  some  knowledge  of 
the  degradation  fimction  H(u,v,f).  However,  the 
degradation  function  as  given  by  Eq.  (2)  consists  of 
two  separable  functions,  S(u,v)  emd  D(f),  where 
S(u,  y)  is  a  purely  static  (spatial)  function  and  D(  f )  is 
a  purely  dynamic  (temporal)  function.  Therefore,  by 
ehminating  the  effects  of  D(f),  one  can  obtain  a 
reasonably  good  displayed  image.  This  is  accom- 
phshed  by  simply  dividing  H{u,  v,f)hyD(f).  Such  a 
restoration  technique,  based  on  the  concept  of  inverse 
filtering,  can  be  applied  in  a  straightforward  fashion 


Fig.  11.  Image  degraded  by  a  motion  of  10  cm/s  at  an  angle  of  30”  restored  by  using  filters  corresponding  to  (a)  6  cm/s.  (b)  8  cm/s,  (c)  10 
cm/s,  (d)  12  cm/s. 
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since  the  modulus  of  D(f)  is  not  zero  except  at 
infinity.  If  this  were  not  true,  such  a  condition  would 
have  posed  a  nuyor  restriction  on  inverse  filtering. 
The  stimulation  of  the  restoration  process  is  summa¬ 
rized  as  follows: 

1.  A  FFT  of  the  degraded  image  gix,y)  is  ob¬ 
tained.  This gives5(u,  v)D(  f). 

2.  Given  the  object’s  velocity  and  direction,  the 
corresponding  inverse  filter,  i.e.,  [D  (/’)]'*  is  calcu¬ 
lated. 

3.  The  results  obtained  in  steps  1  and  2  are 
multiplied  (point  by  point)  in  the  frequency  domain. 

4.  An  inverse  FFT  of  the  result  of  step  3  jrields  the 
restored  image. 

To  restore  the  degraded  image  one  needs  to  know 
the  type  of  phosphor  and  hence  the  corresponding 
time  constant(s)  and  the  value  and  the  direction  of 
the  relative  motion  between  the  sensor  and  the 
target.  One  needs  this  information  to  realize  tO(  / )]"‘, 
as  discussed  above.  While  there  is  no  problem  in 
meeting  the  first  requirement,  often  it  may  be  dif¬ 
ficult  to  estimate  exactly  the  value  of  the  relative 
motion. 

The  real-time  restoration  model  is  shown  in  Fig. 
7(a).  In  this  model  both  the  magnitude  and  the 
direction  of  the  relative  motion  are  determined  first. 
This  information  is  used  in  the  design  of  the  restora¬ 
tion  filter.  A  simple  hybrid  setup  to  perform  the 
restoration  process  is  illustrated  in  Fig.  7(b),  which 
shows  that  a  spatial  light  modulator  can  be  used  to 
imprint  the  inverse  filter.  Note  that  this  real-time 
restoration  model  is  suitable  for  applications  in  which 
both  the  speed  and  the  direction  of  the  relative 
motion  can  be  reasonably  estimated. 

For  applications  for  which  the  relative  motion 
between  the  target  and  the  sensor  is  not  known 
exactly,  a  simpler  restoration  model  like  the  one 
shown  in  Fig.  8  can  be  used.  In  this  simple  system  a 
fixed  Fourier  hologram  may  be  used  to  store  the 
inverse  filter  (for  a  single  specific  speed  or  a  range  of 
speeds).  The  image  of  Fig.  4(c),  for  example,  may  be 
restored  to  some  degree  as  in  Fig.  9(a),  by  using  an 
inverse  filter  designed  for  a  speed  value  of  12  cm/s,  or 
as  in  Fig.  9(b)  by  using  an  inverse  filter  designed  for  a 
speed  of  7  cm/s.  Similarly,  Fig.  10  shows  a  restoration 
of  a  motion-degraded  image  that  is  due  to  horizontal 
motion  of  5  cm/s  when  the  image  is  subjected  to  a 
restoration  filter  designed  for  a  speed  of  10  cm/s. 
Figure  11  shows  restoration  of  images  moving  with  a 
velocity  of  10  cm/s  at  an  angle  of  30°.  Figures  11(a), 
11(b),  11(c),  and  11(d)  show  the  images  restored  by 
using  filters  corresponding  to  6,  8,  10,  and  12  cm/s, 
respectively.  The  restored  images  show  a  great  im¬ 
provement  since  they  are  now  similar  to  the  original 
image.  Observations  suggest  that  it  is  not  always 
necessary  to  know  the  exact  value  of  the  relative 
velocity.  A  value  close  to  the  relative  speed  of  the 


target  is  more  likely  to  provide  a  better  output  image 
of  an  electro-optic^  display  than  one  that  uses  no 
restoration  filter.  It  is  worth  mentioning  that  a 
high-frequency  filter  may  also  be  used  as  a  restora¬ 
tion  filter  since  the  degradation  function  behaves  as  a 
low-pass  filter.** 

VI.  Summary 

In  this  paper  we  have  used  the  dynamic  transfer 
function  to  predict  the  image  quality  and  the  perfor¬ 
mance  of  a  phosphor-based  electro-optical  display.  By 
incorporating  the  concept  of  temporal  response  that 
is  otherwise  missing  from  traditional  imaging  sys¬ 
tems  analysis,  we  can  quantify  degradation  of  the 
output  image  of  an  electro-optical  display.  This  quan¬ 
tification  can  be  used  successfully  to  propose  efficient 
and  real-time  techniques  for  restoration  of  motion- 
degraded  images.  We  have  also  shown  that  for  the 
restoration  of  motion-degraded  displayed  images  it  is 
only  necessary  to  have  a  reasonable  knowledge  of 
relative  velocity.  Work  is  currently  in  progress  to 
identify  a  single  optimum  inverse  filter  as  well  as  an 
optimum  composite  inverse  filter  for  restoration  appU- 
cations. 

The  authors  acknowledge  the  partial  research  sup¬ 
port  provided  by  the  U.S.  Army  Research  Office  under 
contract  DAAL03-87-K-0121  with  the  University  of 
Dayton. 
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1.  INTRODUCTION 

The  available  performance  models'  for  characterizing  thermal 
imaging  systems  capable  of  displaying  static  targets  include 
modulation  transfer  function  (MTF),  minimum  resolvable  tem¬ 
perature  difference  (MRTD),  noise  equivalent  temperature  dif¬ 
ference,  and  minimum  detectable  temperature  difference.  Of 
these  four.  MTF  and  MRTD  are  used  most  widely.  While  MTF 
indicates  the  transfer  performance  of  thermal  imaging  systems 
without  having  considered  the  effect  of  noise,  MRTD  is  a  min¬ 
imum  resolution  index  measure  evaluated  in  the  presence  of 
noise. 

Static  performances  provide  a  good  understanding  of  the  ac¬ 
tual  system  behavior;  however,  too  many  imaging  systems  mon¬ 
itor  moving  scenes  or  targets.  In  such  situations,  the  overall 
imaging  system  behavior  is  often  affected  by  the  temporal 
performances^”"*  of  some  of  the  detectors.  Thus,  to  characterize 
accurately  the  capabilities  of  thermal  imaging  systems,  identi¬ 
fying  an  appropriate  dynamic  measure  is  essential.  Two  recent 
works^'^  have  introduced  the  concepts  of  dynamic  optical  trans¬ 
fer  function  (DOTF)  and  dynamic  MTF  (DMTF),  respectively, 
for  describing  nonscanning  imaging  systems.  More  recently,  we 
have  developed  a  device-nonspecific  generalized  static  model 
for  the  MRTD  measure.*  In  our  current  effort,  we  extend  the 
scope  of  these  earlier  works*'*  and  develop  a  device-nonspecific 
dynamic  MRTD  (DMRTD)  measure  to  serve  as  a  dynamic  per¬ 
formance  model  for  thermal  imaging  systems. 
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In  general,  the  parameter  DMRTD  is  expected  to  be  three- 
dimensional:  two  dimensions  in  the  space  domain  and  one  di¬ 
mension  in  the  time  domain.  In  this  paper,  we  show  that  under 
suitable  conditions  the  three-dimensional  DMRTD  can  be  re¬ 
duced  to  only  spatial  dimensions.  Reference  3  describes  an  ex¬ 
perimental  setup  for  determining  DMTF.  The  test  system  re¬ 
quires  a  light  source  capable  of  flashing  for  an  infinitesimal  time 
interval;  however,  such  ideal  sources  arc  nonexistent.  Therefore, 
any  DMTF  obtained  using  any  realistic  experimental  system  is 
not  necessarily  accurate.  In  this  paper,  an  alternate  method  that 
does  not  require  a  flashing  thermal  source  is  introduced  for 
testing  DMTF  and  DMRTD  of  an  electro-optical  system. 

2.  DMTF  REVIEW 

In  the  static  mode,  a  spatial  impulse  response  is  used  for  char¬ 
acterizing  the  spatial  performance  of  any  arbitrary  optical  sys¬ 
tem.  The  impulse  response,  h,(x,y),  is  the  output  of  the  system 
when  the  system  input  is  a  spatial  Dirac  delta  function,  6(x,y). 
The  Fourier  transform.  H,(fxjy),  of  hAx,y)  is  referred  to  as  the 
optical  transfer  function  of  the  system.  Similarly,  the  temporal 
performances  of  the  system  under  question  may  ^  characterized 
by  a  temporal  impulse  response.  h,(t),  whose  Fourier  transform, 
may  be  referred  to  as  the  system’s  temporal  transfer 
function.  Accordingly,  the  overall  output  of  the  system  may  be 
given  by  a  spatiotemporal  impulse  response.  h(x,y,t),  whose 
Fourier  transform.  Hifxjyjt),  is  the  DOTF  of  the  system.  The 
modulus  of  this  DOTF  is  the  DMTF.* 

It  can  be  shown  that  when  the  system  responses  are  separable, 
i.e.,  when 

h(x,y,t)  =  hx(x,y)h,{t)  ,  (1) 

the  DMTF  of  the  system  is  given  by* 

H(fxJy,f,)  =  Hs(fxJy)H.(f,)  .  (2) 

Consider  now  a  moving  input  object  described  by 
gi(x,y,r)  =  8(x-(- vq/,  y),  such  that  its  spatial  and  temporal  re¬ 
sponses  are  separable.  This  input  function  gi  corresponds  to  a 
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point  light  source  moving  along  the  t-direction  with  a  velocity 
of  v'o.  The  corresponding  output  image  is  obtained  as 

g2(  r.v.r)  =  gi(.t..v,f)  *  h(x.y.i) 

=  5(.t  + I'o/,  y)  *  (/ijU,y)/i,(f))  ,  (3) 

where  ♦  is  the  convolution  operation.  The  Founer  spectrum 
Gzi/xjyji)  of  gzix.y.i)  IS  found  to  yield 

=  f}8(x-hvo/.  y)  *  [/ij(Jc,y )/!,(/)] 

X  exp(  -  iTTji  fxX  -^fyy+fit)  dr  dv  dr 
=  /eSlr'  +  VQ/'.  y')hs{x-x\  y-y')h,(i- 1') 

xexp[-2TTj(fxX+fyy+f,t)]  dr'  dy'  dr'  dr  dy  dr 

cxpl-l-njifxX+fyy+fit)]  dr  dv  dt) 
X  8(r'  +  v’or'.y')  dr'  dy'  dr' 

=  /36(r'  +  voT',  y') 

X  expl  -  l-njifxx'  +/vy'  +/,r')l  dr'  dy'  dr' 

=  Hs(.fxJy)Hiifi)  !  exp(-2Tij(/,vor'll 
xexp{-2Tr;/,r']  dr' 

=  //,(/.,/v)//,(//)8(/,-vo/.)  .  (4) 

where  L  is  an  inieeral  of  order  n.  But  since  it  can  be  shown 
that^ 

/{r)8(r-ri)=/(ri)8(r-ri)  .  (5) 

therefore, 

G2(fx.fyJ,)  =  Hx(fxJy)H,(VQfx)Uf,-VQfx)  .  (6) 

Correspondingly,  however,  the  Fourier  transform  of  gi(r,y.r)  is 
given  by 

Ci(/;t./v./f)  =  /38fr  +  vor,  y)  sxp[-2-nj(fxX+fyy+f,t) 

X  dr  d  y  dr 

=  /  explZiry/^voT)  exp(  -  27ry/,r)  dr 

=  Hft-VQfx)  ■  (7) 


Therefore,  the  overall  transfer  function  for  the  system  is  given  b\ 

Hf/xJyJ,)  =  GlifxJyJ.VGx^fxJ. ,/,) 

=  Hs{fxJx)H,(VQfx)  (S') 

When  V’o  is  unity,  for  simplicu),  Eq.  (8)  reduces  to 
H{fx,fy,f,)  =  H,(fx.fy)HAfx)  .  (9) 

which  readily  corresponds  to  the  DOTF  or  DMTF  of  the  system 
under  question  and  is  a  function  of  only  spatial  variables. 

3-  DMTF 'TEST  SYSTEM 

Identifying  the  temporal  delta  thermal  source  for  the  testing  of 
thermal  imaging  systems  is  difficult.  This  often  implies  that  we 
need  to  secure  a  heating  source  with  zero  heating  capacity  that 
may  give  out  energy  in  an  infinitesimal  time  interval.  Instead, 
we  consider  a  test  system,  shown  in  Fig.  1 ,  where  gi  is  a  point 
source  moving  with  unit  velocity  vq  along  the  x-direction  and 
g2  is  the  corresponding  image  on  the  display  screen  of  the  system. 
The  sensor  array,  S,  measures  the  intensify  distribution  on  the 
screen.  When  the  point  image  picks  up  velocity,  say,  along  the 
x-axis,  the  image  will  appear  blurred  because  of  the  effect  of 
phosphor  decay.*  An  example  of  the  x-dependent  intensity  pro¬ 
file  of  the  display  as  detected  by  the  sensor  array  is  shown  in 
Fig.  2(a).  This  intensity  distribution  is  moving  along  the  x- 
direction.  By  having  chosen  the  proper  moving  coordinate  axis, 
the  intensity  distribution  may  appear  stationary  like  that  shown 
in  Fig.  2(b).  Thus.  Fig.  2(b)  may  be  considered  as  the  temporal 
impulse  response  of  the  system,  provided  the  x-axis  has  been 
changed  to  a  time  axis. 

4.  DMRTD  DEVELOPMENT 

The  quality  of  a  thermal  imaging  system  depends  not  only  on 
spatial  performances,  but  also  on  temporal  performance.  For 


1 


<31 


Rg.  1.  Th«  •xparimental  satup  for  avaluating  OMRTD. 


Rg.  2.  (a)  Tha  intensity  distribution  on  tha  display  and  (b)  the  tem¬ 
poral  impulse  response  of  tha  system. 
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example,  when  a  four-bar  pattern,'’  which  is  used  for  testing 
VIRTD,  is  staDonary,  we  may  recogiuze  the  pattern  on  the  screen; 
however,  if  the  same  pattern  were  to  move,  the  corresponding 
image  on  the  phosphor-based  screen  may  appear  blurred  and  we 
might  need  a  higher  target  temperature  for  preserving  the  same 
level  of  recognition.  Reference  6  already  summanzes  a  device¬ 
nonspecific  static  MRTD  formulation  based  on  the  linear  system 
theory.  Following  an  identical  line  of  argument,  we  now  com¬ 
bine  both  space  and  time  parameters  to  develop  the  DMRTD. 

For  unitormity  with  the  traditional  MRTD  test,  a  dashing 
four-bar  pattern  may  be  used  for  testing  the  temporal  impulse 
response  of  the  to-be-tested  IR  system.  However,  we  prefer  to 
choose  a  spatial  method  for  determining  the  DMRTD  similar  to 
that  used  in  the  evaluation  of  DMTF.  Assume  that  the  four-bar 
pattern  given  by  ho(x  +  voi,  y)  is  moving  with  a  velocity  of  vq 
along  the  .r-direction.  Assume  further  that  the  to-be-tested  IR 
system’s  spatiotemporal  response.  h„{x,y,t),  is  separable  as 
while  at  the  same  time  the  human  eye-brain  spa¬ 
tiotemporal  response,  hmdx.y.t),  is  also  assumed  separable,  such 
that  h^x.y.t)- where  the  additional  sub¬ 
scripts  s  and  /,  lespectively,  refer  to  spatial  and  temporal  com¬ 
ponents.  Accordingly,  the  Fourier  transform  of  the  perceived 
pattern  is  given  by 

G:(/„/v./,) 

=  /3  5i(-t..v.O  ♦  (/zir(.r.y.r)/imi<J:.y./)l 
X  e.\p(  -jl-nt  fxX  +fyy  +/,t )]  dr  dv  dr 

=  /3  Ar/io(j:  + Vo/,  y)  ♦  (/ijr(.i:,y,/)/imt<.r.y,t)l 
X  exp(  -Jlrri  f^x  +/vy  +f,t)\  dt  dy  d/ 

=  Ar//o(  fx  ,/v  )Wir.s(  fx  ,/v  )//n,t  .s(  fx  Jy ) 

^ //ir.l(//Wmf.t( /))§(/(  —  Vo/t)  •  (10) 

The  perceived  signal  is  now  found  to  be 

Sp  =  Iff  G2(fx,fyJ.)  dfx  d/v  d/, 

=  AT//;  Ho(.fxJy)HirAfxJy)M^afx,fy) 

X  //ir.<(/,)A/mf..(/,)8(/,-Vo/J  dfx  d/v  df, 

=  AT/;  Ho{fxJy)HiafxJy)Hrnafx,fy)H,yAyofx) 
X//mf.l(VoA)  dfx  d/v 

=  AT-/;  Hd  fx  ,fy)H,rA  fx  fx  .fy)H„d  fx) 

X//ml'.t(/t)  dfx  dfy  ,  (11) 

when  Vo  is  unity.  Further,  for  simplicity,  we  may  assume  that 
the  input  noise  distribution  is  given  by  w(x-l-vo/,  y).  By  follow¬ 
ing  identical  steps  as  those  used  in  the  derivation  of  Sp,  the 
perceived  noise  is  found  to  be 

np  =  [/;  W(  fx  ./v)//.r.s(  fx  ./v)-//mf.s(  fx  ,fy)%xd  fx)^ 

X//mf..(/J^d/,  d/v]''-  .  '  (12) 

Using  Eqs.  (11)  and  (12),  SNR  may  be  obtained  as 
.  5^  _  HnH,r.sH^uH,xAfx)H^fx(fx)  df,  df. 

np  [/;  WHl,Hli.sH„Afx)H,pfAfx)  dfx  d/v]*'*  ' 


Finally,  the  DMRTD  is  given  by 

DMRTD-  .//.,(/. fS'  df,  dfj‘  - 

//  fx)  dfx  dfy 

where  SNR*  is  the  threshold  value  of  SNR  for  the  human  e\e- 
brain. 

Note  that  SNR*  in  Eq.  ( 14)  is  not  necessarily  a  constant,  but 
a  function  of  spatial  frequency.  We  have  also  shown  that  the 
background  temperature  i»  uiiimaiely  iied  to  tne  MRTD  for¬ 
mula,’^  according  to  which,  Eq.  (14)  should  be  rewntten  to  gi\e 
improved  DMRTD  as 


DMRTD' =—3(DMRTD) 
do 


where  To  represents  the  background  temperature  of  the  target 
and  C  =  7.224x  10  *  W/m'  K"*  (Ref.  10).  The  discrepancy, 
between  die  DMRTD  and  the  improved  DMRTD  (DMRTD  )  is 
given  by 


^  DMRTD  j 
~  DMRTD' 

=  CTq  —  1  .  (16) 


Figure  3  shows  the  values  of  t|  as  a  function  of  To-  When  To  is 
equal  to  i.e.,  240.1576  K.  the  value  of  t)  goes  to  zero. 

Equations  ( 14)  and  (15)  combine  both  the  spatial  point  spread 
and  temporal  impulse  responses.  Equation  ( 14)  is  a  two-dimen¬ 
sional  expression;  however,  the  equation  describes  a  problem  of 
three  dimensions:  two  dimensions  of  space  and  one  of  time. 
Instead  of  the  point  light  source  as  shown  in  Fig.  1.  a  four-bar 
target  pattern  shown  in  Fig.  4  can  be  used  in  the  MRTD  test. 
By  following  the  standard  MRTD  test  procedure. '  ‘  the  DMRTD 


Fig.  3.  Discrepancy,  n.  between  DMRTD  and  DMRTD’  as  a  function 
of  background  temperature. 
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can  be  obtained  by  setting  the  moving  four-bar  target  to  unit 
velocity  along  the  Jt-direction. 

5.  SIMULATION  RESULTS 

Both  Eqs.  ( 14)  and  ( 15)  are  simulated  using  a  computer  program, 
where  SNR,h  =  0,215(/,)°  (Ref,  12),  To  =  215.5  K  (Ref. 
11),  and  W=  1  (for  white  noise), 

_j  l.75(//Mf^.  Qm<(  flM )<0.4 

[2.4  exp[- 1.25(;7jW)-0.41' \  0.4<(y7.Vf  )<3.0 

(17) 

and 

//„,,  =  (! +y2Tr/,T)-'  .  (18) 

where  t  =  0.08s’  ®  and  Hmt.t  is  taken  from  the  values  of  Fig.  5. 
The  DMRTD  response  using  the  aforementioned  parameters  is 


Frequency  (Hz) 

Fig.  5.  A  typical  temporal  transfer  response  of  the  human  eye  (after 
Ref.  13). 


Rg.  6.  MRTD  and  OMRTD  characteristics. 


plotted  in  Fig.  6.  By  comparing  the  corresponding  DMRTD  and 
MRTD  curves,  we  see  that  the  DMRTD  values  are  generally 
larger  than  the  corresponding  .MRTD  values.  This  is  expected 
since  a  larger  temperature  difference  is  necessary  for  discruni- 
nating  a  movmg  target.  Figure  7  shows  the  plot  of  DMRTD  for 
different  values  of  t.  With  higher  values  of  t,  DMRTD  in¬ 
creases.  Finally,  Fig.  8  shows  the  DMRTD'  response  when  the 
background  temperature  To  is  changed  The  higher  To  value 
corresponds  to  lower  DMRTD'  values. 

6.  CONCLUSION 

We  have  developed  a  device-nonspecific  DMRTD  formula.  Most 
of  its  modular  terms  refer  to  general  subsystem  transfer  functions 
without  any  specific  device  index.  The  formula,  however,  is 
flexible  enough  to  adapt  to  almost  any  IR  system  although  use 
of  the  formula  may  appear  inconvenient  at  first  sight  because  of 
its  lack  of  system  indices. 

Equations  (14)  and  (15)  represent  important  measures  for 
characterizing  thermal  imaging  systems  capable  of  displaying 
dynamic  targets.  The  formulation  does  not  involve  any  temporal 
argument.  If  computer  work  is  necessary,  use  of  the  formula 
means  a  huge  savings  in  required  computing  time  and  memory 
space. 
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Abstract.  Discrepancies  between  the  predicted  minimum  resolvable  tem¬ 
perature  difference  (MRTD)  and  field  performances  are  indicative  of  the 
fact  that  the  modeling  of  MRTD  has  certain  inherent  problems.  Several 
sources  for  MRTD  error  are  identified.  MRTD  is  also  shown  to  be  a  special 
case  of  a  more  general  minimum  resolvable  luminance  difference  (MRLD) 
measure.  The  MRLD  measure  involves  absolute  temperature  and  can  be 
used  to  describe  more  generic  targets. 
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1.  INTRODUCTION 

Since  Genoud  and  Sendall's*  introduction  of  the  minimum  re¬ 
solvable  temperature  difference  (MRTD)  concept,  many  models 
have  been  generated  for  the  characterization  of  thermal  imaging 
systems.  The  most  famous  of  these  is  the  Night  Vision  Labo¬ 
ratory  (NVL)  model.*'^  which  is  the  current  standard  of  the  U  S. 
Army.  However,  experimental  MRTD  data  often  differ  from 
that  predicted  by  the  NVL  model."*  Accordingly,  many  efforts^"'* 
have  been  made  to  update  or  modify  the  NVL  model.  But  these 
efforts  haven't  been  able  to  account  for  all  of  the  discrepancies. 
In  this  paper,  we  discuss  both  the  theoretical  as  well  as  exper¬ 
imental  problems  pertaining  to  the  MRTD  measure. 

MRTD  model  development  involved  assumptions  that  are  too 
ideal.  Several  important  facts  such  as  the  background  temper¬ 
ature  effect,  the  nonlineanties  and  spatial  characteristics  of  the 
human  eye-brain  system,  and  the  spatial  frequency  dependent 
signal-to  noise  ratio  (SNR)  were  neglected  in  the  development 
of  the  MRTD  model.  In  our  current  work,  the  impacts  of  these 
simplifications  are  accounted  for  by  adding  up  their  effects  on 
MRTD  formulation. 
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The  very  basic  starting  point  in  the  derivation  of  MRTD  is 
that  the  IR  imaging  system  signal  is  merely  the  temperature 
difference  between  target  and  background.  Stncily  speaking, 
this  IS  not  correct  because  an  IR  imaging  system  does  r,ot  test 
temperature  directly  What  is  detected  by  an  IR  imaging  system 
is  neither  the  temperature  difference  nor  temperature  itself  but 
the  energy  radiated  from  the  target  and  background.  Further¬ 
more.  the  same  temperature  difference  may  cause  quite  a  dif¬ 
ferent  MRTD  value  when  the  absolute  temperature  of  the  target 
(or  background)  is  different. 

To  overcome  the  problems  stated,  a  new  measure  referred  to 
as  the  minimum  resolvable  luminance  difference  i  MRLD)  may 
be  identified  from  the  point  of  view  of  radiated  energy.  While 
the  MRLD  measure  is  more  realistic  than  the  corresponding 
MRTD  measure,  it  also  incorporates  the  contnbution  of  absolute 
temperature.  MRTD  can  be  used  for  blackbodies.  but  not  for 
graybodies  or  spectrally  selected  targets.  Accordingly,  the  use 
of  MRTD  is  somewhat  limited  because  all  of  the  held  scenes 
arc  of  either  the  gray  or  spectrally  selective  type.  While  most 
of  the  laboratory  MRTD  tests  involve  blackbody  sources,  the 
field  test  results  often  correspond  to  a  different  set  of  targets. 
The  discrepancy  between  the  theory  and  acniaJ  data  is  thus  ob¬ 
vious. 

2.  MRTD  FORMULATION  CONSIDERATION 
2.1.  Eye-brain  nonlinearities 

Every  one  of  the  MRTD  models  developed  was  based  on  the 
concept  of  linear  systems.  Accordingly,  all  components  of  the 
MRTD  test  system,  such  as  the  thermal  source,  the  collimating 
optics,  the  to-be-tested  system,  the  observer  s  eye-brain  system, 
and  so  on.  are  assumed  to  be  linear  subsystems.  This  assumption 
is  more  or  less  reasonable  for  all  subsystems  except  the  human 
eye-brain.  A  popular  way  of  analyzing  nonlinear  systems,  how¬ 
ever,  is  to  consider  the  said  nonlinear  system  as  approximately 
linear  and  then  provide  both  limitation  and  errors  caused  by  this 
approximation. 

Human  eye-brain  response  is  not  linear.  In  fact,  at  least  two 
nonlinear  visual  phenomena  exist  that  may  contnbute  to  nonlin- 
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.ur  errors.  First,  the  rclationsnip  beiueen  the  perceived  hnent- 
less  /,,  and  incident  intensitv  /,„  is  approximately  loganthmic  " 
heure  1  shows  the  corresponding  relationship  as  well  as  the 
inear  approximation  I'p  ot  the  response  where  It,  represents  the 
‘background  intensity  present  on  the  retina  TTie  linearly  approx- 
:maied  perceived  brightness  can  be  expressed  in  terms  ol  the 
incident  intensity  by 

loat  Ih  I 

/:.  -  —  i,„ 


=  logt/,„) 


/,n  log! //.I  -  Ih  logl/,n) 

/(,  lOgi/,;.) 


Il) 


The  second  term  of  Eq.  1 1 ).  which  is  a  function  of  both  //,  and 
l,„.  corresponds  to  the  relative  error  caused  by  the  linear  ap¬ 
proximation. 

The  second  nonlinear  error  encountered  in  eye-bram  modeling 
IS  caused  by  the  lateral  inhibitory  interaction  of  the  human  visual 
svsiem.  The  inhibitory  phenomenon  that  occurs  in  the  receptor 
generally  inhibits  its  neiehborhotxJ.  The  strength  of  inhibition 
at  a  point  due  to  an  excited  receptor  is  inversely  proportional  to 
the  distance  between  the  studied  point  and  the  receptor,  but  it 
IS  directly  proportional  to  the  strength  ot  the  excited  receptor, 
f  igure  2  shows  a  typical  retinal  input  and  the  corresponding 
retinal  output"’  from  which  it  can  be  inferred  that  lateral  inhi- 


approxiraation. 


Fig.  1.  The  incident  light  intensity  versus  perceived  brightness. 


Position 

Fig.  2.  Retinal  light  distributions  and  the  corresponding  brightness 
response  (after  Ref.  10). 


bition  produces  output  that  peaks  at  or  near  reeiuns  where  the 
input  intensity  changes  most  rapidly  Funhermore.  the  height  of 
the  output  IS  proportional  to  the  spatial  rate  ot  change  ot  intensity 
at  the  input  The  sharper  the  imensity  change,  the  larger  the 
output 

The  sharpness  of  the  input  may  be  desenbed  by  the  denvative 
ot  the  input  light  distribution  on  the  retina.  The  peaL-to-peak 
vanation  in  the  output  response  can  be  quantihed  by  the  product 
of  distance  and  the  denvative  of  input  distnbution  Note  that 
the  peak-to-peak  value,  by  definition,  is  the  signal  used  in  .MRTD 
formulation  This  signal  is  essentially  nonlinear.  The  top  branch 
of  Fig.  3  shows  a  typical  MRTD  test  system,  which  includes 
the  transfer  function  of  the  eye.  H„,  i.  This  panicular  transfer 
function,  however,  is  determined  by  testing  a  spatial  frequence 
adjustable  sine-wave  target  in  which  me  effect  of  inhibition  is 
much  less  than  that  on  the  standard  MRTD  target  Note  that  a 
rectangular- wave  target  is  associated  w  ith  sharper  edges  In  other 
words,  a  human  eye  perceives  a  rectangular- wave  target  to  have 
a  much  stronger  output  (at  the  edges)  than  a  sine- wave  target 
In  principle,  therefore,  the  to-be-considcred  H„,  \  should  be  de 
nved  using  the  standard  four-bar  pattern  instead  of  the  sine  w  ave 
one.  Since  this  is  not  the  case,  an  auxiliary  module  is  added  in 
parallel  to  the  eye  transfer  model  of  Fig.  3  to  account  for  the 
addiuonal  uifubiuon  effect,  which  is  given  by 
where  C  corresponds  to  a  distance  factor  that  depends  on  the 
shape  of  the  input  and  W,  and  respectively,  represent  the 
transfer  functions  of  the  target  and  IR  system,  and  f,  and  t\, 
respectively,  represent  spatial  frequencies  along  honzontal  and 
vertical  directions.  The  perceived  signal  is  thus  given  by 

Sp  =  \\H,H.rH„n  (l  dA  (2) 

The  second  term  of  Eq.  (2)  desenbes  the  relative  error  tor  the 
inhibitory  effect  that  is  otherwise  introduced  by  the  sine-wave 
target. 

The  human  eye  can  be  empirically  modeled  as  : 

^  |l.75(//M)’^'’  .  0.()l<(//A/)<().4 

|2.4  expl  -  1.25(///V/)-().4l' ^  0.4  S(//.V/ )<3.0  ' 

(3) 

where  /  is  the  spatial  frequency  of  the  four-bar  target  and  M  is 
the  magnification  of  the  system.  The  curve  for  Eq.  (3)  is  shown 
for  comparison  along  with  the  Ratches  eye  model  and  the  re¬ 
sponse  of  a  lens"^  in  Fig.  4.  The  values  pertaining  to  Campbell  s 
model  decrease  at  lower  spatial  frequencies  because  of  the  built- 
in  inhibitory  effect,  which  is  charactenstic  of  an  ac  amplifier. 
The  ordinary  lens  does  not  involve  any  inhibitory  effect  and  that 
IS  why  Its  response  is  rather  similar  to  that  of  a  dc  amplifier. 
Ratches  model,  on  the  other  hand,  is  approximately  similar  to 
that  of  an  ordinary  lens  but  with  an  exponential  trend  It  is  this 


Fig.  3.  Block  diagram  for  the  MRTD  test  system. 
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Fig.  4.  Contrast  sensitivity  of  different  eye-brain  models. 


Rg.  5.  MRTOs  corresponding  to  different  eye-brain  models. 


latter  eye  model  that  results  in  significant  error  at  lower  spatial 
frequencies.  A  computer  simulation  may  be  used  to  compute 
and  compare  the  corresponding  MRTDs.  Figure  5  shows  the 
measured  MRTD  characteristics^  as  well  as  that  corresponding 
tc  both  Ratches  and  Campbell  eye  models. 

2.2.  Eye-brain  spatial  characteristics 

The  two  types  of  light  receptors  of  a  human  eye  retina  are  cones 
and  rods.  The  cones  respond  most  effectively  in  bright  envi¬ 
ronment  while  the  rods  respond  in  the  dark.  The  density  distri¬ 
butions  of  both  cones  and  rods  on  the  retina  are  not  linear.  In 
general,  only  cones  are  considered  in  MRTD  evaluation.  If  the 
density  distribution  of  human  cones  were  to  indicate  the  sensi¬ 
tivity  distribution  of  the  retina,  we  would  notice  that  the  sizes 
of  images  on  the  retina,  in  general,  are  significant  within  a  range 
between  near-zero  degrees  through  about  10  deg  with  retinal 
sensitivity  changing  by  a  factor  of  20.  In  general,  therefore,  the 
linear  systems  theory  may  not  be  enough  to  describe  the  human 
eye-brain  response. 

2.3.  SNR  variation 

Most  of  the  MRTD  models  use  the  SNR  threshold  of  tne  human 
eye-brain  system  as  a  constant,  e.g..  2.25.  for  the  complete 
spatial  frequency  range.*  However,  a  recent  study^  has  shown 
that  the  SNR  and  spatial  frequency  /  are  related  by; 


SNR  =  0.215 

Figure  6  shows  the  corresponding  SNR  response.  Incorporation 
of  Eq.  (4)  in  the  MRTD  modeling  is  expected  to  improve  the 
overall  MRTD  measure. 

2.4.  Temperature  effects 

As  mentioned,  in  the  MRTD  test  system,  what  is  received  by 
the  detector  from  the  to-be-tested  device  is  not  the  temperature 
of  the  target,  but  the  energy  radiated  by  the  target.  Furthermore, 
the  traditional  definition  of  MRTD  is  independent  of  the  absolute 
value  of  the  background  temperature;  it  depends  only  on  the 
temperature  difference  between  the  target  and  the  background. 
This  assumption  pertaining  to  MRTD  is  expected  to  affect  the 
corresponding  outcome  considerably. 

According  to  the  Stefan-Boltzmann  law.  the  radiant  excitance 
of  a  blackbody  source"  is: 

M  =  aT'  ,  (5) 

where  T  is  its  temperature  and  a  =5.67023  x  10~*  W/m*  K^. 
Furthermore,  if  the  source  is  Lambertian,  the  radiance  L  is  found 
to  be 

L  =  MItt  =  C'T*  .  (6) 

where  C'  =a/Tr.  Consider  To  to  be  the  background  temperature 
and  AT  the  temperature  difference  between  the  target  and  the 
background;  then  the  radiance  difference  AL  between  the  target 
and  the  background  is  given  by 

AL  =  C'(ro  +  Ar)'‘-C'To 

=  C' [( To  +  47^ at  +  6r^ AT^  +  4To AT^  +  A7^)  -  To] 

=  C'[4r^Ar-^6r^Ar^-H4roAT-^  +  AT-‘]  .  (7) 

Equation  (7)  can  be  simplified  by  ignoring  the  higher  order  AT 
terms  to  give 

AL  =  4C'tIAT 

=  CTIaT  ,  (8) 

where  C  =  4C'. 


SNR 


Rg.  6.  Experimantally  derived  SNR  as  a  function  of  spatial  frequency 
(after  Ref.  9). 


1 790  '  OPTICAL  ENGINEERING  N-  ,nber  1991/  Vol  30  No  11 


MINIMUM  RES0LVA8L£  TEMPERATURE  DIFFERENCE  MODEL  A  CRITICAL  EVALUATION 


1 


Considering  now  that  what  is  received  by  the  to-be-tested 
device  is  not  temperature,  but  the  energy  irradiated  by  both  the 
target  and  the  background,  the  perceived  signaj’  is  given  by 

sp  =  AlJ  j H.H.rHmf  ifx  d/v  ■  (9) 

Since  the  signal  is  defined  in  terms  of  its  peak-to-peak  value, 
the  corresponding  two-dimensional  image  distribution  on  the 
display  screen  is: 

ej(x.y)  =  Midix.y)  ,  (10) 


SNR,J  WHrrHn:,  d/,  d/. 


d/.  df. 


(14) 


The  second  factor  on  the  right  side  of  Eq.  ( 14)  is  the  classical 
MRTD.^  The  improved  MRTD.  denoted  by  MRTD',  is  thus 
given  by 


MRTD' =  -^  (MRTD)  . 

CTo 


(15) 


where  AL  is  the  luminance  difference  between  the  target  and 
background  and  id(x.y)  is  the  normalized  distribution  of  the 
target  picture  incident  on  the  display  screen. 

Since  the  perceived  noise^  is  given  by 


WHlH^fdU  dfy 


1/2 


(11) 


where  W  is  the  input  noise  power  spectral  density,  the  SNR  is 
given  by 


AlJJw, //„//„/  df,  dfy 

SNR  = - [72  (12) 

^||ww,i//4d/,  d/vj 

and.  therefore. 


SNR,/,0|w//,i//4'd/.  dfy 


1/2 


AZ.  =  - 


fjH,H.rH„fdf,  dfy 


(13) 


Equation  (13)  defines  an  energy  measure  that  may  be  referred 
to  as  the  blackbody  MRLD.  By  means  of  Eqs.  (8)  and  (13),  AT 
can  be  derived  to  give 


Rg.  7.  The  deviation  of  contrast  threshold  versus  spatial  frequency- 


which  shows  that  the  true  MRTD  value  is  indeed  influenced  by 
the  background  temperature.  Reference  12  specifies  the  range 
of  273  to  278  K  for  To.  A  simple  computation  shows  that  To 
changes  within  this  range  may  contribute  to  an  error  of  6% . 

3.  MRTD  EVALUATION  CONSIDERATIONS 

3.1.  Eye-brain  randomness 

To  a  great  extent,  the  observers  involved  in  the  recognition  of 
the  standard  MRTD  test  pattern  during  the  characterization  of 
infrared  imaging  systems  respond  randomly.  Accordingly,  the 
measured  values  should  be  interpreted  in  a  probabilistic  manner. 
In  the  study  of  random  events,  it  is  not  enough  to  discuss  only 
(he  mean  of  the  sample  space.  Consider,  for  example,  that  in 
the  opinion  of  ten  observers,  the  mean  MRTD  value  is.  say. 
l.S  K  at  a  spatial  frequency  of  0.69  cycles/mrad.  Correspond¬ 
ingly,  the  true  MRTD  value  for  a  90%  confidence  level  lies 
within  the  range  1.5  1:0.73.  The  AT  range  between  0.77  and 
2.23  K  is  referred  to  as  the  confidence  interval.  For  the  given 
confidence  level,  all  of  the  values  that  lie  within  this  range  are 
possible  MRTD  values.  We  can  reasonably  assume  that  the 
MRTD  measurements  obey  a  Gaussian  distribution.  The  con¬ 
fidence  interval  is  x±ZaJi{oln),  where  x  is  an  approximation  of 
the  true  value  (in  our  case,  it  is  the  average  value  obtained  from 
ail  observers),  z  represents  the  normalized  Gaussian  distribution 
parameter,  a  is  the  value  of  the  confidence  level,  n  is  the  sample 
size,  and  a  is  the  standard  deviation.'^  Based  on  data  from 
Ref.  14,  we  may  obtain  the  standard  deviation  as  a  function  of 
spatial  frequency  as  shown  in  Fig.  7. 

For  a  constant  value  of  x.  a.  and  a.  the  confidence  interval 
is  a  function  of  n  only.  Figure  8  shows  the  relationship  between 
the  confidence  interval  Cl  and  n  for  two  particular  spatial  fre¬ 
quencies.  The  smaller  values  of  n  correspond  to  larger  values 
of  CIs.  Therefore,  if  more  accurate  MRTD  data  are  to  be  ex¬ 
pected.  n  must  be  made  larger.  For  example,  a  total  of  550 
observers  will  be  required  in  the  MRTD  test  to  achieve  a  90% 
confidence  interval  of  x  ±0.1  at  a  spatial  frequency  of  0.69 
cycles/mrad.  Also,  if  the  data  were  to  be  collected  at  a  higher 
spatial  frequency,  say,  1.15  cycles/mrad.  the  variance  require¬ 
ment  would  be  so  large  that  a  few  thousand  observers  might  be 
needed  for  the  MRTD  test.  Unfortunately,  in  most  of  the  MRTD 
tests,  the  number  of  observers  is  usually  between  two  and  five 
while  the  accuracy  discussed  is  often  better  than  0. 1 . 

3.2.  Nonstandardization  errors 

Although  Ref.  13  specifies  the  MRTD  test  procedure,  the  de¬ 
tailed  test  processes  are  quite  different  for  each  of  the  test  groups. 
Typical  nonstandardization  problems  associated  with  MRTD 
measurements  include  aspects  related  to  distance  between  the 
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Fig.  10.  Contratt  sansitivitY  for  two  different  luminances.  The  circles 
are  for  sine>wava  gratings  and  the  squares  are  for  square-wave  grat¬ 
ings.  The  upper  pair  is  for  500  cd/m^,  while  the  lower  pair  is  for 
0.05  cd/m^  (after  Ref.  9). 


display  screen  and  the  observer,  background  brightness,  binoc¬ 
ular  issues,  and  strain.  The  experimental  data  shown  in  Fig.  9 
reveal  that  for  a  constant  viewing  angle  the  contrast  sensitivity 
is  relatively  independent  of  the  viewing  distance.  This  indicates 
that  if  the  observer  were  to  adjust  the  viewing  distance  while 
keeping  the  viewing  angle  invariant  for  every  test  situation,  both 
the  spatial  frequency  of  image  and  the  perceived  spatial  fre¬ 
quency  remain  unchanged.  In  other  words,  it  is  quite  misleading 
to  refer  to  the  test  result  as  being  caused  by  the  eye-brain’s 
transfer  function  when  the  distance  is  allowed  to  be  adjusted 
during  the  test.  In  practice,  many  of  the  MRTD  tests  do  not  take 
this  fact  into  consideration. 

Figure  10  shows  two  sets  of  test  data  for  different  background 
brightnesses.  In  general,  the  contrast  sensitivity  increases  with 
background  luminance.  However,  during  the  MRTD  test,  the 
display  screen  brightness  is  often  adjusted  by  the  observer.  This 
is  expected  to  cause  considerable  additional  inconsistencies  be¬ 
tween  results  obtained  by  different  observers.  Again,  the  MRTD 
formulations  are  based  on  a  monocular  eye  model  while  MRTD 


0  1  1  10 


Spatial  Frequency  (cy/deg) 

Fig.  9.  Contrast  sensitivity  for  sine-wave  gratings  at  a  luminance 
value  of  500  cd/m^:  (A)  viewing  distance  57  cm,  aperture  10  x  10; 
(B)  viewing  distance  57  cm,  aperture  2x2;  and  (C)  viewing  distance 
285  cm,  aperture  2x2  (after  Ref.  15). 


measurements  are  conducted  using  both  eyes.  This  is  perhaps 
because  the  binocular  eye  model  is  not  too  well  understood. 
Last,  each  of  the  observers  expends  great  effort  during  an  MRTD 
test.  Since,  over  a  prolong  period,  human  eye-brain  sensitivity 
decreases,  the  human  eye-brain  system  may  not  be  treated  as 
time-invariant. 

4.  MRLD  FORMULATION 

The  MRLD  corresponding  to  the  blackbody  scene  was  derived 
in  Eq.  (13)  and  is  related  to  MRTD  by 

MRLDfl=CT^(MRTD)  ,  (16) 

where  MRLDg  reduces  to  the  classical  MRTD  when  To  is  equal 
to  ( 1/C)'^^.  Again,  since  MRLD  and  MRTD  are  linearly  related, 
the  new  measure  is  also  a  function  of  spatial  frequency.  In  this 
section,  we  extend  the  MRLD  definition  to  include  graybody 
and  spectrally  selective  scenes. 

In  practice,  the  scene  is  referred  to  as  a  graybody  if  an  extra 
radiation  source  exists,  such  as  the  moon  in  the  background.  If 
the  target  and  background  are  both  Lambertian,  the  total  lumi¬ 
nances  of  target  and  background  are  respectively  given  by 

L,=  I/TT(e,M,  +  r,(£b+Es)]  .  (17) 

Lb=\/Tt(ebMb  +  rbEs)  ,  (18) 

where  E,  r,  and  e  represent  total  incident  illuminance,  reflec¬ 
tance.  and  emittance.  respectively,  while  the  subscripts  b.  s. 
and  t  refer  to  the  background,  extra  source,  and  target,  respec¬ 
tively.  Note  that  in  Eq.  (18)  the  effect  of  illuminance  from  the 
target  has  been  ignored.  Accordingly,  the  luminance  difference 
AL  can  be  expressed  as 

AL  =  L,-Lb 

=  l/TTle,M,  +  r,{Eb  +  Es)-ebMb-rbEs] 

=  l/TT[e,(TT}  +  r,Eb  +  Esir,-rb)-eh(TTt]  ■  (19) 
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But  since  T,  =  Tb  +  Af.  Eq.  (19)  reduces  to 

M  =  l/-Trle,CT(  Tb  +  4TllT  +  6nir  +  4TbM^  +  Ar*) 

+  r,Eb4-Es(r,-rb)-eb(jTb]  (20) 

Bv  ignonng  the  higher  order  terms,  therefore,  the  graybody 
MRLD  can  be  given  by 

MRLDg  =  l/Tr(4<?,arb(MRTD)  +  aZllf,  -  et) 

+  r,Eb+Es(r,-rb)]  ■  (21) 

Again.  MRLD  reduces  to  MRTD  when  e,  =  eb=  I,  r,  =  rb  =  0, 
and  To  is  equal  to 

A  source  is  referred  to  as  spectrally  selective  when  its  em- 
issi  vity  is  dependent  on  the  wavelength.  For  a  spectrally  selective 
target  and  spectrally  selective  background,  the  total  luminance 
Li  and  Lb  are  respectively  given  by 


L,  =  y'n(M,n+r,„Ebn+r,„Es)  .  (22) 

Lb=l/Tf(Mbn  +  rbnE,)  ,  (23) 

where  the  subscripts  m  and  bn  refer  to  the  spectrally  selective 
target  and  spectrally  selective  background,  respectively,  such 
that 


-V/,n  =  j  dX  . 

—  -x 

X 

i^bn  “  j  ^bn^ bni^)  l^X 


(24) 


(25) 


When  the  emittances  are  equal  to  unity  and  the  reflectances  are 
zero,  the  generalized  MRLD  reduces  to  that  of  a  blackbods  . 
which  in  turn  reduces  to  the  classical  MRTD  when  To  is  equal 
to(l/C)‘'^ 

5.  SIMULATIONS  FOR  MRLD 

In  this  section.  Eq.  (31).  is  used  to  simulate  several  imponant 
MRLD  features.  Figures  11.  12.  and  13  show  the  influence  of 
the  reflectances  r,  and  rj,  on  MRLD.  In  Fig.  11(a).  the  solid 
curve  corresponds  to  r,  =  rj,  =  0,  while  the  dashed  one  indicates 
the  situation  when  r,  =  0.9  and  rb  =  0  with  rb  =  240. 1576  K. 
e,  =  e*  =  1 ,  and  £,  =  £<,=  1 .  Figure  12  shows  the  corresponding 
case  where  rs  is  changed  from  0  to  0.5  while  r,  =  0.  Figure  13 
shows  the  case  where  the  solid  curve  corresponds  to  r,  =  r/,  =  0 
and  the  dashed  one  indicates  the  situation  when  r,  =  0.9  and 
ri,=0.5.  In  practical  tests,  the  Nyquist  frequency  is  considered 
as  the  reference  spatial  frequency  at  which  an  empirically  de¬ 
termined  value  is  assumed  to  be  equal  to  the  predicted  one. 
Figure  1 1(b)  shows  the  corresponding  siniation.  which  we  may 
refer  to  as  the  noimalized  diagram,  when  the  dashed  curve  is 
moved  upward  by  a  value  equal  to  the  MRLD  difference  (be¬ 
tween  the  two  at  Nyqu  frequency).  We  find  that  the  two  curves 
in  each  case  are  absoli  .ely  matched  throughout  the  whole  range. 

Figures  14.  15,  and  16  show  the  influences  of  Eb  and  f  >  on 
MRLD.  In  Fig.  14,  the  dashed  curve  represents  the  case  for 
which  £(,=  1.0  and  £j  =  1 .5,  while  the  solid  curve  corresponds 
to  the  case  for  which  £(,  =  2.5  and  £,  =  1.5.  In  Fig.  15.  the 
da  bed  curve  represents  the  case  for  which  £(,  =  2.5  and  £,  =0.5. 
while  the  solid  curve  corresponds  to  £(,  =  2.5  and  £,  =  1  5.  Fi¬ 
nally,  in  Fig.  16.  the  dashed  curve  corresponds  to  £(,  =  2.0  and 
£,  =0.5.  and  the  solid  one  corresponds  to  £(,  =  2.5  and  £,  = 
1.5.  In  all  of  these  cases,  we  used  e,  =  e(,  =  1.  r,  =  0.9.  r(,  =  0.5. 
and  ro  =  240. 1576  K.  Figures  14(b)  through  16(b)  show  the 
corresponding  normalized  diagrams,  which  match  throughout 
the  whole  range  of  frequency. 


Also,  from  the  definition  of  total  emissivity  of  the  spectrally 
selective  scene,  we  know  that 


^tn  ~ 


^bn  — 


M, 

^bn 

Mb 


(26) 

(27) 


Thus,  we  have 

M,n  =e,„M,  =e,„crTt  ,  (28) 

Mb„  =  ebnMb=ebn<yTh  ■  (29) 


Equations  (22)  and  (23)  can  be  used  to  obtain  the  corresponding 
spectrally  selective  MRLD.  MRLD/v,  as 

MRLDa/  =  l/Tr[4e,„CTrb(MRTD)  +  aTb{e,„  -  eb„) 

+  r,„Eb„+EArtn-rbn)]  ■  (30) 

The  generalized  MRLD.  therefore,  may  be  given  by 

MRLD=  l/TT[4e,uTb(MKTD)+(TTt{e,-eb) 

+  r,Eh+EArt-rb)]  ■  (31) 


Fig.  11.  (a)  Influence  of  reflectances  on  MRLD  and  (b)  normalized 
diagram  of  (a). 
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The  effect  of  the  background  emittance  eb  on  MRLO  is  shown 
in  Fig.  17(a).  The  dashed  curve  is  for  eb  =0.75;  the  solid  one 
is  for  e*  =  0.79  when  e,  =  0.8,  r,  =  rj,  =  0.  and  To  =  240. 1576  K. 
Again,  the  corresponding  normalized  diagram  is  shown  in 
Fig.  17(b),  which  is  matched  throughout  the  whole  range  of 
frequency. 


Figures  18(a)  and  19(a)  show  MRTD  curves  for  different 
target  emittances  e,  when,  for  example,  r,  =  rj,  =  0  and 
ro  =  240. 1576  K.  In  Fig.  18(a)  the  solid  curve  represents 
et  =  eb  =  I,  and  the  dashed  curve  is  for  e,=0.9  and  eb  =  1 .0.  In 
Fig.  19(a)  the  dashed  curve  is  for  e,  =  =  1 ,  and  the  solid  curve 

is  for  e,  =  0.8  and  e/,  =  0.79.  Figures  18(b)  and  19(b)  show  the 
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corresponding  normalized  diagram  where,  interestingly,  the  curves 
are  not  matched  over  the  range  of  frequency  considered.  Finally, 
Fig.  20(a)  shows  the  MRLD  values  for  different  background 
temperatures  when,  for  example,  e,  =  e*  =  1  and  r,  =  ri,=0.  The 
dashed  curve  is  the  traditional  MRTD,  i.e  ,  when  To^  240. 1576  K; 
and  the  solid  curve  represents  the  situation  when  To  =  278  K. 
Figure  20(b)  shows  the  corresponding  normalized  diagram  where 
the  curves  are  also  not  matched. 


6.  DISCUSSION 

The  concept  of  MRTD  is  based  on  the  blackbody  environment. 
However,  we  are  also  interested  in  the  behaviors  of  graybody 
and  colored  body  environments  for  two  reasons.  (1)  for  esti¬ 
mating  errors  encountered  in  an  actual  MRTD  test  environment 
and  (2)  for  generalizing  the  MRTD.  Since  MRLD  is  a  more 
generalized  version  of  MRTD,  the  study  of  MRLD  is  expected 
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Fig.  20.  (a)  Influence  of  background  temperature  on  MRLO  and 
(b)  normalized  diagram  of  (a). 


to  reveal  MRTD  characteristics  for  different  environment-related 
parameters. 

Equation  ( 3 1 )  gives  the  MRLD  formulation,  which  is  affected 
by  three  parameters:  emittance.  reflectance,  and  illuminance. 
All  three  parameters  affect  MRLD  in  certain  ways.  Considering 
MRTD  as  the  argument  in  Eq.  (31),  r,  £,  and  e*  affect  MRTD 
only  in  terms  of  the  intercept  along  the  MRLD  axis,  which  is 
evident  in  Figs.  1 1  through  16.  These  parameters  affect  only 
the  position  of  the  MRTD  curve,  so  the  two  curves  are  absolutely 
matched  when  the  two  Nyquist  points  are  matched.  Accordingly, 
the  corresponding  MRTD  errors  can  be  corrected  easily  by  prop¬ 
erly  tuning  the  IR  system.  The  parameter  e,,  however,  affects 
MRTD  both  in  terms  of  the  slope  and  ordinate-intercept  as  shown 
by  Fig.  17(b).  This  error  cannot  be  eliminated  by  any  means. 
Note  that  the  discrepancy  shown  in  Fig.  19  corresponds  to  only 
a  1%  emittance  difference,  which  exists  between  target  and 
background.  Therefore,  the  standard  MRTD  test,  if  it  is  to  deliver 
accurate  measurements,  must  incorporate  the  fact  that  both  the 
target  and  background  are  exact  blackbodies.  In  reality,  this 
condition  is  never  met.  This  is  perhaps  why  the  predictions  of 
MRTD  are  optimistic  at  lower  spatial  frequencies  and  pessimistic 
at  higher  spatial  frequencies  when  compared  to  laboratory  mea¬ 
surements.  Figures  18(b)  and  19(b)  similarly  justify  the  fact  that 
emittance  is  also  a  critical  parameter  for  accuracy. 

Besides  these  effects,  the  absolute  temperature  of  background 
(or  target)  affects  the  MRTD  very  significantly.  Figure  20  shows 
the  corresponding  situation.  The  background  temperature  is  set 
at  240.1576  K  for  the  traditional  MRTD.  which  is  shown  in 
Fig.  20  by  the  dashed  curve.  The  solid  curve  corresponds  to  a 
background  temperature  of  278  K,  which  is  at  the  highest  end 
of  the  range.  The  maximum  error  encountered  thereby  is  55%. 
Thus,  the  background  temperature  is  also  a  critical  condition  for 
MRTD  accuracy.  Thus,  the  standard  specification  for  an  MRTD 
test  must  specify  the  background  temperature  with  a  certain 
specific  temperature  rather  than  a  range  of  temperatures. 


7.  CONCLUSIONS 

MRTD  formulation  is  associated  with  a  number  of  error  sources. 
The  most  important  of  these  is  traced  back  to  eye-brain  modeling. 
In  general,  the  eye-brain  model  is  dependent  on  the  target’s 
shape.  Accordingly,  an  eye-brain  model  based  on  the  standard 
four-bar  target  should  only  be  used  for  calculating  .MRTD.  Fur¬ 
thermore.  the  eye  model  for  the  signal  and  that  for  the  noise  are 
not  the  same. 

The  discrepancies  between  expenmental  data  as  well  as  that 
between  data  and  theory  can  be  traced  to  two  sources:  theory  as 
well  as  experimental  conditions.  For  reliable  comparison  be¬ 
tween  the  predicted  and  measured  data,  a  standardized  and  un¬ 
ambiguous  test  setup  needs  to  be  defined. 

We  have  developed  a  novel  .MRLD  measure  to  characterize 
IR  imaging  systems.  It  has  the  dimension  of  watt  per  unit  area, 
while  MRTD  has  the  dimension  of  temperature.  .VIRLD  mea¬ 
surements  involve  the  absolute  temperature  of  the  target  (or 
background).  Furthermore,  MRLD  is  general  enough  and  is  not 
limited  to  blackbodies.  It  can  be  shown  that  MRTD  is  a  special 
case  of  MRLD  and  that  MRTD  can  be  obtained  from  blackbody 
MRLD  by  setting  To  equal  to  ( 1/C)‘'^. 
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